Published May 27, 2022 | Version v1
Poster Open

Checklist Strategies to Improve the Reproducibility of Deep Learning Experiments with an Illustration

Creators

  • 1. FRB-CESAB, Montpellier, FR
  • 2. University of São Paulo, BR
  • 3. The University of Queensland, AU
  • 4. ERINHA (European Research Infrastructure on Highly Pathogenic Agents) AISBL, FR
  • 5. Research-Team ICAR, LIRMM, CNRS, Univ. Montpellier, FR
  • 6. IRD
  • 7. American Geophysical Union, USA
  • 8. LIRMM, CNRS
  • 9. Espace-Dev (IRD-UM-UG-UR-UA-UNC)
  • 10. MARBEC, University of Montpellier

Description

The challenges of Reproducibility and Replicability (R&R) have become a focus of attention in order to promote open and accessible research. Therefore,  efforts have been made to develop good practices for R&R in the area of computer science. Nevertheless,  Deep Learning (DL) based experiments remain difficult to reproduce by others due to the complexity of these techniques. In addition, several challenges concern the use of massive and heterogeneous data that contribute to the complexity of this R&R. Firstly, we compiled three different aspects to help researchers to improve R&R. This compilation was based on machine learning checklists, guidelines, and principles from FAIR. Therefore, this compilation is useful for a (1) researcher seeking to reproduce a paper, (2) an author reporting on an experiment, and (3) a reviewer seeking to qualify the scientific contributions of the work. Secondly, we illustrate the compilation of three recent DL experiments for socio-economic estimation using remotely sensed data.

Poster to be presented during RDA 19th Plenary Meeting, Part Of International Data Week, 20–23 June 2022, Seoul, South Korea

Notes

Acknowledgments: The PARSEC project is funded by the Belmont Forum, Collaborative Research Action on Science-Driven e-Infrastructures Innovation. J.M. is grateful for the support from FAPESP (grant 2020/03514–9).

Files

Checklist Strategies to Improve the Reproducibility of Deep Learning Experiments with an illustration.pdf

Files (1.2 MB)