Reporting and dashboards' design for Open Science monitoring

At the Italian Institute of Technology (IIT), several resources are being committed to monitoring the institute's scientific production, enabling efficient data mining and data visualization of information coming from different systems: this process begins to include Open Science (OS). The recognition of OS is based both on new and updated institutional policies and on tools and technologies, allowing monitoring of such practices. 

IIT seeks to expand its ecosystem of tools and reports to monitor OS practices/contributions, producing measures and dashboards that can add another dimension to the analysis of the research outputs, thus acting as starting points for reasoning on OS indicators and their implications. Tools and services that can cover some aspects of OS are planned and put in place. Examples of activities include: 

1. Links to open access versions of the scientific papers whose metadata are stored in our CRIS Scientilla are provided. The links are fetched using OpenAIRE webservices and they are displayed on the IIT website. 

2. Development of scripts to obtain from the Unpaywall APIs the Open Access (OA) status of a publication (Green, Bronze, Gold, Hybrid, Closed) to monitor the quantity and the type of OA of the IIT publications. 

3. Involvement in a project between IIT and the QUEST Center for Responsible Research at the Berlin Institute of Health, funded by the Berlin University Alliance. Using the text-mining tool ODDPub developed at QUEST, it is investigated to which extent the IIT scientific papers contain links to datasets or source code shared by the authors, to find insights about sharing practices for each research domain of IIT. It is the first time that such kind of monitoring is being tried at our institute. 

4. Assessing FAIRness: tests were performed with the F-UJI Automated FAIR Data Assessment Tool (developed under FAIRsFAIR project) on the datasets shared in the IIT Dataverse repository, to get results about the FAIRness of a shared dataset in an automatic way. 

5. Including information about preprints can be added to our CRIS Scientilla, since preprints represent another aspect of OS. 

The activities mentioned above provide data that are going to be used to create Open Science reports, in form of pdf documents and informative dashboards, at several levels of aggregation: not only the management, but also the scientists can then see and acknowledge the importance of OS, getting acquainted with OS jargon and with the systems to monitor it. For example, dashboards related to pre-prints and the OA status of a manuscript can be added into the CRIS Scientilla, next to the other charts related to the scientific production, to start showing the multifaceted aspects of OS to scientists and group leaders. 

IIT strives for the recognition of full range of diverse scientific outputs, including OS aspects, rewarding research quality and good science together with other established measures of research impact. IIT joined the Coalition for Advancing Research Assessment (CoARA), signing its agreement, and it is currently writing its institutional CoARA roadmap. Supported by the services and tools mentioned above, the IIT roadmap will include the recognition of OS aspects, too.