Next Generation Spacecraft Pose Estimation Dataset (SPEED+)

SPEED+ is the next-generation dataset for spacecraft pose estimation with specific emphasis on the robustness of Machine Learning (ML) models across the domain gap. Similar to its predecessor, SPEED+ consists of images of the Tango spacecraft from the PRISMA mission. SPEED+ consists of three different domains of imageries from two distinct sources. The first source is the OpenGL-based Optical Stimulator camera emulator software of Stanford’s Space Rendezvous Laboratory (SLAB), which is used to create the synthetic domain comprising 59,960 synthetic images. The labeled synthetic domain is split into 80:20 train/validation sets and is intended to be the main source of training of an ML model.

The second source is the Testbed for Rendezvous and Optical Navigation (TRON) facility at SLAB, which is used to generate two simulated Hardware-In-the-Loop (HIL) domains with different sourcesof illumination: lightbox and sunlamp. Specifically, these two domains are constructed using realistic illumination conditions using lightboxes with diffuser plates for albedo simulation and a sun lamp to mimic direct high-intensity homogeneous light from the Sun.

Compared to synthetic imagery, they capture corner cases, stray lights, shadowing, and visual effects in general which are not easy to obtain through computer graphics. The lightbox and sunlamp domains are unlabeled and thus intendeded mainly for testing, representing a typical scenario in developing a spaceborne ML model in which the labeled images from the target space domain are not available prior to deployment.

SPEED+ is made publicly available to the aerospace community and beyond as part of the second international Satellite Pose Estimation Competition (SPEC2021) co-hosted by SLAB and the Advanced Concepts Team (ACT) of the European Space Agency.

The construction of the TRON testbed was partly funded by the U.S. Air Force Office of Scientific Research (AFOSR) through the Defense University Research InstrumentationProgram (DURIP) contract FA9550-18-1-0492, titled High-Fidelity Verification and Validation of Spaceborne Vision-Based Navigation. The SPEED+ dataset was created using the TRON testbed by SLAB at Stanford University. The post-processing of the raw images was reviewed by ACT to meet the quality requirement of SPEC2021.

For more details on the dataset and the competition, please visit https://kelvins.esa.int/pose-estimation-2021/