Comparing FAIR Assessment Tools and their Alignment with FAIR Implementation Profiles using Digital Humanities Datasets

FAIR Assessment Results of Two Digital Humanities Datasets and Some Comparison with Their Corresponding FAIR Implementation Profiles

Andre Valdestilhas (VU Amsterdam), 

Menzo Windhouwer (KNAW - Humanities Cluster), 

Ronald Siebes  (VU Amsterdam), 

Shuai Wang  (VU Amsterdam and Maastricht University)

Contact: Andre Valdestilhas (a.valdestilhas@vu.nl)

This repository consists of supplementary materials corresponding to the research paper titled Comparing FAIR Assessment Tools and Their Alignment with FAIR Implementation Profiles using Digital Humanities Datasets, that is to be presented at the International Workshop of Semantic Digital Humanities (SemDH) Workshop, co-collated with the Extended Semantic Web Conference (ESWC) 2025.

The ZIP file consists of the following folders. 

• The ./FIPs folder consists of details of the two FIPs used: one corresponding to the CLARIN community, and the other corresponds to the ODISSEI Portal community. Note that the former is a large infrastructure with many subcommunities. The latter is a subcommunity of ODISSEI. The FIPs were created using the FIP Wizard (https://fip-wizard.ds-wizard.org/wizard/). The nanopublications were included as well.  The latest version of the corresponding FIPs, FICs, and related FERs can be found on the FAIR Connect portal: https://fairconnect.pro/search-fair-nanopublications/. 

• The folder ./FAIR_Assessment consists of the results from the two FAIR assessment tools. The assessment were conducted on 18th April 2025. The result of the FAIR Cheker were obtained from its web server. The results of the FAIR Enough were obtained from a local instance of the Docker image. 

• In the current directory, you can see the file Assessment_Results_and_Evalaution. This document consists of five tabs:

• The first one corresponds to the Research Question 1 (RQ1). We study how the FAIR Assessment Metrics align with the questions of FIP. The first column is the (sub-)principles of FAIR and the columns corresponds to FAIR Checker, FAIR Enough, and the FAIR Implementation Profile (FIP). Note that there is no perfect alignment. Sometimes there are cases of one-to-multiple. In this project, we tried our best to stick with a one-to-one mapping unless there is nothing to be matched with. 

• The second and third tabs are the FAIR Assessment results of FIR Checker and FAIR Enough respectively. The results correspond to the documents mentioned above in the FAIR_Assessment Folder. This was used for answering RQ2.

• The last two tabs correspond to the comparison of FAIR assessment results with FIPs. Column D was highlighted. It is for a comparison of the overlapping metrics of the two FATs. Moreover, we studied if their assessment results align. 

• The last two columns are about the FIPs. Assessment results can be found in the paper.