Dataset Open Access

MOBDrone: a large-scale drone-view dataset for man overboard detection

Donato Cafarelli; Luca Ciampi; Lucia Vadicamo; Claudio Gennaro; Andrea Berton; Marco Paterni; Chiara Benvenuti; Mirko Passera; Fabrizio Falchi

Data curator(s)
Donato Cafarelli; Luca Ciampi; Lucia Vadicamo

Dataset

The Man OverBoard Drone (MOBDrone) dataset is a large-scale collection of aerial footage images. It contains 126,170 frames extracted from 66 video clips gathered from one UAV flying at an altitude of 10 to 60 meters above the mean sea level. Images are manually annotated with more than 180K bounding boxes localizing objects belonging to 5 categories --- person, boat, lifebuoy, surfboard, wood. More than 113K of these bounding boxes belong to the person category and localize people in the water simulating the need to be rescued.

In this repository, we provide:

  • 66 Full HD video clips (total size: 5.5 GB) 

  • 126,170 images extracted from the videos at a rate of 30 FPS (total size: 243 GB)

  • 3 annotation files for the extracted images that follow the MS COCO data format (for more info see https://cocodataset.org/#format-data):

    • annotations_5_custom_classes.json: this file contains annotations concerning all five categories; please note that class ids do not correspond with the ones provided by the MS COCO standard since we account for two new classes not previously considered in the MS COCO dataset --- lifebuoy and wood

    • annotations_3_coco_classes.json: this file contains annotations concerning the three classes also accounted by the MS COCO dataset --- person, boat, surfboard. Class ids correspond with the ones provided by the MS COCO standard.

    • annotations_person_coco_classes.json: this file contains annotations concerning only the 'person' class. Class id corresponds to the one provided by the MS COCO standard.

The MOBDrone dataset is intended as a test data benchmark. However, for researchers interested in using our data also for training purposes, we provide training and test splits:

  • Test set: All the images whose filename starts with "DJI_0804" (total: 37,604 images)
  • Training set: All the images whose filename starts with "DJI_0915" (total: 88,568 images)

More details about data generation and the evaluation protocol can be found at our MOBDrone paper: https://arxiv.org/abs/2203.07973
The code to reproduce our results is available at this GitHub Repository: https://github.com/ciampluca/MOBDrone_eval
See also  http://aimh.isti.cnr.it/dataset/MOBDrone

Citing the MOBDrone

The MOBDrone is released under a Creative Commons Attribution license, so please cite the MOBDrone if it is used in your work in any form.
Published academic papers should use the academic paper citation for our MOBDrone paper, where we evaluated several pre-trained state-of-the-art object detectors focusing on the detection of the overboard people

@inproceedings{MOBDrone2021,
title={MOBDrone: a Drone Video Dataset for Man OverBoard Rescue},
author={Donato Cafarelli and Luca Ciampi and Lucia Vadicamo and Claudio Gennaro and Andrea Berton and Marco Paterni and Chiara Benvenuti and Mirko Passera and Fabrizio Falchi},
booktitle={ICIAP2021: 21th International Conference on Image Analysis and Processing},
year={2021}
}

and this Zenodo Dataset

@dataset{donato_cafarelli_2022_5996890,
author={Donato Cafarelli and Luca Ciampi and Lucia Vadicamo and Claudio Gennaro and Andrea Berton and Marco Paterni and Chiara Benvenuti and Mirko Passera and Fabrizio Falchi},
  title        = {{MOBDrone: a large-scale drone-view dataset for man overboard detection}},
  month        = feb,
  year         = 2022,
  publisher    = {Zenodo},
  version      = {1.0.0},
  doi          = {10.5281/zenodo.5996890},
  url          = {https://doi.org/10.5281/zenodo.5996890}
}

Personal works, such as machine learning projects/blog posts, should provide a URL to the MOBDrone Zenodo page (https://doi.org/10.5281/zenodo.5996890), though a reference to our MOBDrone paper would also be appreciated.

 

Contact Information

If you would like further information about the MOBDrone or if you experience any issues downloading files, please contact us at mobdrone[at]isti.cnr.it

 

Acknowledgements

This work was partially supported by NAUSICAA - "NAUtical Safety by means of Integrated Computer-Assistance Appliances 4.0" project funded by the Tuscany region (CUP D44E20003410009). The data collection was carried out with the collaboration of the Fly&Sense Service of the CNR of Pisa - for the flight operations of remotely piloted aerial systems - and of the Institute of Clinical Physiology (IFC) of the CNR - for the water immersion operations. 

Files (248.6 GB)
Name Size
annotations_3_coco_classes.json
md5:9f56a55b0fc72e678848d9e2039aa17b
54.6 MB Download
annotations_5_custom_classes.json
md5:11f578ff9ede473005d72ccccd0ae82b
60.5 MB Download
annotations_person_coco_classes.json
md5:c3c97f5518440489e686b63525fb6d3e
45.3 MB Download
images.zip
md5:1b31337600eec5fecd858e5a5112aa8d
243.0 GB Download
MOBDrone_videos.zip
md5:250c19fdd6fb0b5aa5fa43e5ad140306
5.5 GB Download
README.pdf
md5:69d0eeb7aaa44785d16f6ee39679822c
69.4 kB Download
209
274
views
downloads
All versions This version
Views 209209
Downloads 274274
Data volume 19.8 TB19.8 TB
Unique views 171171
Unique downloads 136136

Share

Cite as