ELIXIR Europe

Part of EU Open Research Repository

There is a newer version of the record available.

Published February 11, 2025 | Version 0.2.0
Dataset Open

Software Quality Indicators: extraction, categorisation and recommendations from canonical sources

Authors/Creators

  • 1. ROR icon Barcelona Supercomputing Center
  • 2. Centre for Research and Technology Hellas
  • 3. ROR icon European Molecular Biology Laboratory
  • 4. ROR icon SIB Swiss Institute of Bioinformatics
  • 5. ROR icon University of Manchester
  • 6. ROR icon University of Padua
  • 7. University of California, Santa Cruz
  • 8. ROR icon European Bioinformatics Institute
  • 9. ROR icon Vlaams Instituut voor Biotechnologie
  • 10. ROR icon Forschungszentrum Jülich
  • 11. ROR icon Universidad Politécnica de Madrid
  • 12. ROR icon University of Southern California
  • 13. University of Amsterdam
  • 14. ROR icon Leiden University Medical Center
  • 15. EDMO icon European Molecular Biology Laboratory - European Bioinformatics Institute
  • 16. EDMO icon Chalmers University of Technology

Description

Extraction, categorisation and recommendations of research software quality indicators from seven canonical source. This work began at the BioHackathon 2024 (BH24) as Project #5.

Over 300 indicators from seven sources were extracted. In follow on calls after the BH24 can carried on refining the indicators - and deciding on which ones should be kept, maybe kept and discarded; this was informed by duplicate indicators and those that advocated a particular philosophy that might not have being universally recognised as necessary for quality research software. We also highlighted the difficulty level in implemented the indicators - i.e. in how much effort was required (easy, possible, hard) in ascertaining whether software, a service or project governance satisfied a particular indicator.

This is made available to allow others to use this as a starting point for their own project considerations of which software quality indicators to include and/or take into account.

There are current gaps around green software indicators and the FAIR supergroup categorisation are not all present.

This exercise did not define new indicators, it set out to categorise existing indicators from various canonical sources (both in the research software space and in the wider software engineering space).

You can see the slide about progress at the BH24 and further work has been undertake as part of the ELIXIR Tools Platform WP3 (Software Best Practices group + it was open to those who attended the BH24 Project #5) which is part of the ELIXIR Scientific Programme of Work 2024-2028.

Some individuals who took part were funded by the EOSC EVERSE and ELIXIR STEERS projects.

This is currently a work in progress so not all indicators have been categorised and there maybe definitions may be paraphrased rather than verbatim.

Files

Files (443.8 kB)

Name Size Download all
md5:d9aeeb679bdc363c4c96e30693543e50
149.7 kB Download
md5:85484d6ce93eb7a6e5c63de43c35ae48
294.1 kB Download

Additional details

Funding

European Commission
EVERSE - European Virtual Institute for Research Software Excellence 101129744
European Commission
ELIXIR-STEERS - ELIXIR-STEERS 101131096

Software

Development Status
Wip