PathOS - D3.4 Data and Tools for the Long-term Evaluation of Open Science

This is a reference report, meant to support reusability and sustainability of PathOS tools and datasets for OS impact evaluation. It complements the Indicator Handbook,1 deliverable D3.3 (Open Science Impact Indicators for Case Studies, Final Report), the DMP (D3.5), and technical repositories (GitHub/Zenodo). 
The report focuses on the implementation dimension of Open Science impact evaluation, detailing how indicators were produced from the datasets, how tools were combined across infrastructures, and what technical and methodological challenges emerged. It highlights the adaptations required to ensure data harmonization, cross-platform interoperability, and reproducible computation of OS indicators under diverse conditions. The document provides:

• Technical specifications of the data sources and analytical tools used for indicator construction
• Descriptions of the processing workflows and integration pipelines
• Reflections on operational issues such as data quality, classification accuracy, and  identifier consistency
• Lessons learned to inform future evaluations and methodological refinement. 

The six PathOS case studies collectively demonstrate the implementation of Open Science (OS) impact indicators across a range of disciplinary, thematic, and national contexts. Each applied a harmonised analytical framework but adapted its depth and focus according to the specificities of its data environment, stakeholder ecosystem, and infrastructure maturity. Most case studies operated with standardised datasets and bibliometric integration workflows. The “French Open Access Infrastructure” case study includes extended documentation due to the legal, administrative, and technical complexity of processing national-scale data under GDPR compliance, ensuring methodological transparency and supporting future reuse of this setup as a reference for Open Science monitoring at national and institutional levels.