DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Dataset

Dataset for the DREAMING - Diminished Reality for Emerging Applications in Medicine through Inpainting Challenge

More information about the challenge can be found on the challenge website!

Timeline:

8th January 2024: First subset of training & validation data available.

22nd January 2024: Second subset of training & validation data available.

29th January 2024: Full training & validation data available.

Description:

The dataset was created using Unreal Engine 5.1, Unreal MetaHumans, 3D-COSI surgical instruments, POV-Surgery grasp generation and EasySynth.

Each scene contains:

• "color": RGB input images
• "gt": RGB ground truth images
• "mask": Mask defining the area to be inpainted. White -> Background, Black -> Inpainting area
• "CameraPoses.csv": Camera poses
• "CameraRig.json": Camera intrinsics