EOSC-Life WP4 Toolbox: Pilot study protocol for the evaluation of the categorisation system

The Horizon 2020 project EOSC-Life brings together the 13 Life Science ‘ESFRI’ research infrastructures to create an open, digital and collaborative space for biological and medical research. Sharing sensitive data is a specific challenge within EOSC-Life. For that purpose, a toolbox is developed, providing information to researchers who wish to share or use sensitive data. An essential component of this toolbox will be a knowledge base of categorised (tagged) resources linked to sensitive data sharing in the research areas of EOSC-Life. The categories are designed to support consistent labelling and categorisation of the stored resources, in terms most relevant to data sharing tasks and activities, so that they are available to users (e.g., as on screen filters) when searching the system. Objective of the pilot study is to evaluate the applicability and appropriateness of the categorisation system, as well as the coverage of the different research areas involved in EOSC-Life. Six research infrastructures will participate in the pilot study. Three infrastructures (BBMRI, EATRIS, ECRIN) will each nominate two experts who will independently assess 25 self-selected resources. The same procedure will be applied by the other infrastructures (EMBRC, ERINHA and Euro-BioImaging) for 10 self-selected resources. The assessments will be documented per infrastructure and a summary statistics of agreements and disagreements between experts will be provided. The results will be used as a basis for an improvement and update of the categorisation system.