Report Open Access

How reproducible should research software be?

Sam Harrison; Abhishek Dasgupta; Simon Waldman; Alex Henderson; Christopher Lovell

In this article, we attempt to answer the question of how reproducible research software should be by defining four levels of reproducibility, suggesting criteria to help you decide which level your research software should be at, and recommending practices to reach these levels of reproducibility. The article is the result of a discussion session at the Software Sustainability Institute Fellows Online Selection Day 2021.

Files (209.0 kB)
Name Size
209.0 kB Download
  • Wilson et al (2017). Good enough practices in scientific computing. doi: 10.1371/journal.pcbi.1005510

  • Lee et al (2021). Barely sufficient practices in scientific computing. doi: 10.1016/j.patter.2021.100206

  • McArthur (2019). Repeatability, Reproducibility, and Replicability: Tackling the 3R challenge in biointerface science and engineering. doi: 10.1116/1.5093621

All versions This version
Views 1,0141,014
Downloads 641641
Data volume 134.0 MB134.0 MB
Unique views 933933
Unique downloads 571571


Cite as