Published October 25, 2023 | Version 1
Journal article Open

Establishing a national research software award

  • 1. Ministère de l'Enseignement supérieur et de la Recherche, F-75000 Paris, France
  • 2. Inria, Université Paris Cité, F-75000 Paris, France
  • 3. Univ. Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL, Centre de Recherche en Informatique Signal et Automatique de Lille, F-59000 Lille, France
  • 4. Univ. Artois, CNRS, UMR 8188, Centre de Recherche en Informatique de Lens, F-62300 Lens, France
  • 5. Univ. Grenoble Alpes, Grenoble INP Institute of Engineering, CNRS, UMR 5224 LJK, Laboratoire Jean Kuntzman, F-38000 Grenoble, France
  • 6. Direction de la recherche clinique et de l'innovation, Assistance Publique - Hôpitaux de Paris, F-75000 Paris, France

Description

Software development has become an integral part of the scholarly ecosystem, spanning all fields and disciplines. To support the sharing and creation of knowledge in line with open science principles, and particularly to enable the reproducibility of research results, it is crucial to make the source code of research software available, allowing for modification, reuse, and distribution.

Recognizing the significance of open-source software contributions in academia, the second French Plan for Open Science, announced by the Minister of Higher Education and Research in 2021, introduced a National Award to promote open-source research software. This award serves multiple objectives: firstly, to highlight the software projects and teams that have devoted time and effort to develop outstanding research software, sometimes for decades, and often with little recognition; secondly, to draw attention to the importance of software as a valuable research output and to inspire new generations of researchers to follow and learn from these examples.

We present here an in-depth analysis of the design and implementation of this unique initiative. As a national award established explicitly to foster Open Science practices by the French Minister of Research, it faced the intricate challenge of fairly evaluating open research software across all fields, striving for inclusivity across domains, applications, and participants. We provide a comprehensive report on the results of the first edition, which received 129 high-quality submissions. Additionally, we emphasize the impact of this initiative on the open science landscape, promoting software as a valuable research outcome, on par with publications.

Software is crucial for modern research. For the goals of open science, reproducibility, and wider reuse, sharing software source code and acknowledging software development are essential. In France, in 2021, the Minister of Higher Education and Research introduced the National Plan for Open Science.

The plan highlights the role of open-source software in academia and aims to give software the same recognition as publications and data. A part of the plan is the introduction of a National Award to recognize open-source research software contributions. This award acknowledges software projects and their teams, which have often worked without much recognition. It also emphasizes the importance of software as a research output, hoping to inspire future researchers.

This article examines the award's design and implementation. It addresses the challenges of assessing open research software from different research fields. In the first edition of the award, there were 129 high-quality submissions, indicating the award's potential to shift perspectives on software's role in open science, aligning it with the importance of academic publications. Through a detailed account of our experiences and the insights gained, we aim to provide a reference for other countries or institutions considering to establish similar recognitions.

Files

openreseurope-3-17349.pdf

Files (1.4 MB)

Name Size Download all
md5:aec1dce966d12c05f6fb2970a5cd8f45
1.4 MB Preview Download

Additional details

References

  • (2023). Open science monitor.
  • Van Noorden R, Maher B, Nuzzo R (2014). The top 100 papers. Nature. doi:10.1038/514550a
  • (2021). French policy on data, algorithms and open source.
  • (2021). Second National Plan for Open Science.
  • Di Cosmo R (2020). Archiving and referencing source code with Software Heritage. doi:10.1007/978-3-030-52200-1_36
  • Di Cosmo R (2022). Building the software pillar of Open Science.
  • Rougier NP, Hinsen K, Alexandre F (2017). Sustainable computational science: The ReScience initiative. PeerJ Comput Sci. doi:10.7717/peerj-cs.142
  • Benureau FCY, Rougier NP (2018). Re-run, Repeat, Reproduce, Reuse, Replicate: Transforming Code into Scientific Contributions. Front Neuroinform. doi:10.3389/fninf.2017.00069
  • Wilkinson MD, Dumontier M, Aalbersberg IJJ (2016). The FAIR Guiding Principles for scientific data management and stewardship. Sci Data. doi:10.1038/sdata.2016.18
  • Lamprecht AL, Garcia L, Kuzak M (2020). Towards FAIR principles for research software. Data Science. doi:10.3233/DS-190026
  • Smith AM, Katz DS, Niemeyer KE (2016). Software citation principles. PeerJ Comput Sci. doi:10.7717/peerj-cs.86
  • Smith AM, Niemeyer KE, Katz DS (2018). Journal of Open Source Software (JOSS): Design and first-year review. PeerJ Prepr. doi:10.7717/peerj-cs.147
  • (2015). Dagstuhl Artifacts Series (DARTS).
  • Colom M, Kerautret B, Krähenbühl A (2019). An Overview of Platforms for Reproducible Research and Augmented Publications. doi:10.1007/978-3-030-23987-9_2
  • Greuel GM, Sperber W (2014). swmath - an information service for mathematical software. doi:10.1007/978-3-662-44199-2_103
  • Allen A, Berriman GB, DuPrie K (2020). The Astrophysics Source Code Library: What's New What's Coming. doi:10.48550/arXiv.1712.02973
  • (2019). Paris Call: Software Source Code as Heritage for Sustainable Development.
  • (2022). Agreement on reforming research assessment.
  • Alliez P, Di Cosmo R, Guedj B (2020). Attributing and Referencing (Research) Software: Best Practices and Outlook From Inria. Comput Sci Eng. doi:10.1109/MCSE.2019.2949413
  • (1983). ACM Software System Award.
  • (2005). Award for the Advancement of Free Software.
  • (2005). O'Reilly Open Source Award.
  • (2005). Software of the year award.
  • (1983). Computer Graphics Achievement Award.
  • Sutcliffe G (2016). The CADE ATP System Competition - CASC. AI Magazine.
  • Wooldridge M (2020). The software that led to the lockdown.