Published September 21, 2025 | Version v1
Preprint Open

FIP Check: A Rubric-Based Tool for Assessing FAIR Implementation Profiles and Enabling Resources

  • 1. ROR icon San Diego Supercomputer Center
  • 2. GraybealSKI Consulting
  • 3. mabablue GmbH
  • 4. Leiden Academic Center for Drug Research
  • 5. partners in FAIR
  • 6. ROR icon GO FAIR Foundation
  • 7. Knowledge Motifs LLC
  • 8. SciLifeLab
  • 9. Kairoi
  • 10. ROR icon National Center for Supercomputing Applications

Description

As communities increasingly aim to understand and demonstrate how their data repositories support the FAIR Principles, decision-makers need tools that provide a clear, actionable snapshot. This paper introduces FIP Check, a framework for assessing FAIR Implementation Profiles (FIPs) through a structured assessment of FAIR Enabling Resources (FERs). Built on the FIP ontology, the FIP Check brings three key innovations to FAIR assessment. First, it enables granular and practical evaluation by using a principle-aligned rubric to assess individual FERs. Second, it measures partial FAIRness through a progressive scoring scale that captures varying levels of FAIR alignment, offering constructive, context-aware feedback rather than purely binary results. Additionally, this tool complements existing FAIR assessment tools by focusing on FERs as the units of assessment rather than on entire repositories or datasets. Third, it ensures transparent and inspectable balance by embedding expert-informed assessments within a standardized rubric and making all scoring decisions directly visible. FIP Check was piloted across seven biomedical data repositories, testing its utility in identifying strengths and actionable gaps, and supporting more informed FAIR improvement efforts. It enables communities to assess their current practices and plan targeted enhancements. By providing detailed insights into how individual FERs contribute to FIP’s FAIR alignment, the FIP Check transforms the FAIR Principles from abstract ideals into practical guidance—supporting strategic alignment, fostering shared understanding, and encouraging repository owners to see their resources not only as providers of data, but as infrastructure components.

Files

20250921_FIP-Check.pdf

Files (1.1 MB)

Name Size Download all
md5:46342f35ba461d1a95ef327e2d0950ab
1.1 MB Preview Download

Additional details

Funding

National Cancer Institute

References

  • Candela, L., Mangione, D., & Pavone, G. (2024). The FAIR Assessment Conundrum: Reflections on Tools and Metrics. Data Science Journal, 23(33). DOI: 10.5334/dsj-2024-033.
  • Devaraju, A., & Huber, R. (2020). F-UJI - An Automated FAIR Data Assessment Tool. Zenodo. DOI: 10.5281/zenodo.6361400.
  • Devaraju, A., Huber, R., Mokrane, M., Herterich, P., Cepinskas, L., de Vries, J., L'Hours, H., Davidson, J., & Angus White. (2020). FAIRsFAIR Data Object Assessment Metrics (0.4). Zenodo. DOI: 10.5281/zenodo.4081213.
  • European Commission. (2024, October). FAIR to Adapt to Climate Change (FAIR2Adapt), European Commission. DOI: 10.3030/101188256.
  • FAIRification Framework. (n.d.). Fairification Framework Architecture. Retrieved August 11, 2025, from https://fairification-framework.readthedocs.io/en/latest/architecture/.
  • FAIRmetrics & FAIRsharing. (n.d.). FAIR Evaluation Services. FAIRsharing. Retrieved June 26, 2025, from https://fairsharing.github.io/FAIR-Evaluator-FrontEnd.
  • FAIRsharing. (n.d.). Tools. FAIRassist. Retrieved August 11, 2025, from https://fairassist.org/tools.
  • Gaignard, A., Rosnet, T., de Lamotte, F., Lefort, V., & Devignes, M. (2023). FAIR-Checker: supporting digital resource findability and reuse with Knowledge Graphs and Semantic Web standards. Journal of Biomedical Semantics, 14. DOI: 10.1186/s13326-023-00289-5.
  • Gargio, D. (n.d.). Architecture: FAIR-IF. OS Trails. Retrieved August 11, 2025, from https://docs.ostrails.eu/en/update-restructure/architecture/fair_if.html#fair-reference-model-conceptual-components.
  • GO FAIR. (n.d.). FAIR Convergence Matrix & FAIR Implementation Profiles. Retrieved August 11, 2025, from https://www.go-fair.org/today/fair-matrix/.
  • GO FAIR Foundation (n.d.-a). FIP Wizard (Version 4.0). https://fip.fair-wizard.com/.
  • GO FAIR Foundation. (n.d.-b). FSR Curation. GitHub. https://github.com/gofair-foundation/fsr_curation.
  • GO FAIR Foundation. (n.d.-c). Interpreting FAIR. Retrieved August 11, 2025, from https://www.gofair.foundation/interpretation.
  • GO FAIR US. (2025). FIP-Check. GitHub. https://github.com/go-fair-us/fip-check.
  • Hoebelheinrich, N.J., Graybeal, J., Kherroubi Garcia, I., Christopher, J., Christopher, E., & Kirkpatrick, C. (2025). A persona-specific method to assess the FAIRness of data repositories. [Preprint]. Zenodo. https://doi.org/10.5281/zenodo.13992885.
  • Jacobsen, A., de Miranda Azevedo, R., Juty, N., Batista, D., Coles, S., Cornet, R., Courtot, M., Crosas, M., Dumontier, M., Evelo, C. T., Goble, C., Guizzardi, G., Kryger Hansen, K., Hasnain, A., Hettne, K., Heringa, J., Hooft, R. W. W., Imming, M., Jeffery, K. G., Kaliyaperumal, R., Kersloot, M. G., Kirkpatrick, C. R., Kuhn, T., Labastida, I., Magagna, B., McQuilton, P., Meyers, N., Montesanti, A., van Reisen, M., Rocca-Serra, P., Pergl, R., Sansone, S.-A., da Silva Santos, L. O. B., Schneider, J., Strawn, G., Thompson, M., Waagmeester, A., Weigel, T., Wilkinson, M. D., Willighagen, E. L., Wittenburg, P., Roos, M., Mons, B., & Schultes, E. (2020). FAIR Principles: Interpretations and Implementation Considerations. Data Intelligence, 2(1-2). 10-29. https://doi.org/10.1162/dint_r_00024.