Responsible AI in Research Assessment: A Landscape Analysis

As AI transforms research practices and assessment, the scientific community faces unprecedented ethical challenges. The CoARA Working Group on Ethics and Research Integrity Policy in Responsible Research Assessment for Data and Artificial Intelligence (CoARA-ERIP) aims to develop comprehensive frameworks for responsible AI integration in research assessment.

This document outlines the project and is structured as follows. In chapter 2 an introduction of CoARA-ERIP is given. In chapter 3 the ethical framework and guiding principles that the Landscape project operates within is described and its four central values “fairness and non-discrimination, transparency and explainability, accountability and responsibility, and integrity and quality assurance” are described in detail. Chapter 4 outlines the data management and reproducibility protocol of the project and how they align with and support the ethical framework. In chapter 5 the main outcomes of the landscaping project, the curated review of assessment practices, tools, and actors, is described. In chapter 6 - 9 the action plans of the different aspects of the landscaping are described. In chapter 10 the resource requirements, in chapter 11 the risk management, in chapter 12 the success metrics, in chapter 13 the sustainability plan, and in chapter 14 the implementation timeline is described.