Published June 30, 2023 | Version v1
Project deliverable Open

OPUS Deliverable 2.1 Interventions to test in the pilots

  • 1. Vitae

Description

This report is D2.1 of the OPUS project on Interventions to Test in the Pilots. It proposes a first draft framework of interventions that has been designed to support and accompany the OPUS Research Assessment Framework (RAF) which offers a comprehensive suite of indicators and metrics for research-performing organisations (RPOs) and research-funding organisations (RFOs) to assess researchers for career progression and grant applications. It will also support a specific framework of indicators and metrics to incentivise and reward Open Science career practice, the Open Science Career Assessment Matrix (OSCAM). Detailed description of the framework can be found in D3.1 Indicators/Metrics to Test in the Pilots which should be read in partnership with this document.
This is intended to be a draft framework which will then be tested in two ways during the OPUS project. Firstly, it will be open to wider sector consultation which we intend will be credible and robust to align and build on existing similar initiatives that are in progress for example, the Coalition for Advancing Research Assessment (COARA) and another Horizon Europe project GRASP OS. Secondly it will be tested as part of the OPUS project in our three-pilot RPOs and two RFOs. Feedback will then be incorporated and considered in detail to inform the final versions of the two complementary frameworks – D2.4 Interventions for Open Science and D3.4 Indicators for Open Science.

Files

OPUS_D2.1_Interventions_FINAL.pdf

Files (2.4 MB)

Name Size Download all
md5:c0cec8ede5c513e8645ce45056bc31c6
2.4 MB Preview Download

Additional details

Funding

UK Research and Innovation
OPUS - Open Universal Science 10054677
European Commission
OPUS – Open Universal Science 101058471

References

  • O'Neill, G. (2024). OPUS Deliverable 3.1: Indicators and Metrics to Test in the Pilots. Zenodo. https://doi.org/10.5281/zenodo.10670779
  • Huntingford, J., O'Neill, G., Lebhart, F., Mitrovic, D., Haluskova, K., Pučėtaitė, R., Novelskaitė, A., Day, E., Chaves Chaparro, J., & Crowley, J. (2023). OPUS Deliverable 1.2: Initial State of the Art on Open Science Literature. Zenodo. https://doi.org/10.5281/zenodo.8410050
  • Website of the San Francisco Declaration on Research Assessment (DORA). Link: [https://sfdora.org]. Accessed 30 June 2023.
  • Website of the Leiden Manifesto for Research Metrics. Link: [http://www.leidenmanifesto.org]. Accessed 30 June 2023.
  • Webpage of the Hong Kong Principles hosted by the World Conference on Research Integrity Foundation (WCRIF). Link: [https://www.wcrif.org/guidance/hong-kong-principles]. Accessed 30 June 2023.
  • Open Science Policy Platform (OSPP) (2018) OSPP-REC. Open Science Policy Platform Recommendations. Link: [https://op.europa.eu/en/publication-detail/-/publication/5b05b687-907e-11e8-8bc1-01aa75ed71a1]. Accessed 30 June 2023.
  • Open Science Policy Platform (OSPP) (2020) Progress on Open Science. Towards a Shared Research Knowledge System. Link: [https://op.europa.eu/en/publication-detail/-/publication/d36f8071-99bd-11ea-aac4-01aa75ed71a1]. Accessed 30 June 2023.
  • United Nations Educational, Scientific, and Cultural Organisation (UNESCO) (2017) Recommendation on Science and Scientific Researchers. Annex II of the Records of the 39th Session of the UNESCO General Conference. Link: [https://unesdoc.unesco.org/ark:/48223/pf0000260889]. ccessed 30 June 2023.
  • United Nations Educational, Scientific, and Cultural Organisation (UNESCO) (2021) Recommendation on Open Science. Link: [https://unesdoc.unesco.org/ark:/48223/pf0000379949]. Accessed 30 June 2023.
  • Webpage of the Agreement on Reforming Research Assessment hosted by the Coalition for Advancing Research Assessment (CoARA) Link: [https://coara.eu/agreement/the-agreement-full-text]. Accessed 30 June 2023.
  • European Research Area and Innovation Committee (ERAC) Triangle Task Force (2021) Research Evaluation in a Context of Open Science and Gender Equality. Link: [https://data.consilium.europa.eu/doc/document/ST-1201-2021-INIT/en/pdf]. Accessed 30 June 2023.
  • European Council (2022) Council Conclusions on Research Assessment and Implementation of Open Science. Conclusions adopted by the European Council at European Council Meeting 3877 in June 2022. Link: [https://www.consilium.europa.eu/media/56958/st10126-en22.pdf]. Accessed 30 June 2023.
  • European Commission (2023) Technical Document on a European Framework for Research Careers. Unpublished document for the European Research Area and Innovation Committee (ERAC) Plenary Meeting in February 2023.
  • Vitae (2011) Researcher Development Framework. Link: [https://www.vitae.ac.uk/vitae-publications/rdf-related/researcher-development-framework-rdf-vitae.pdf]. Accessed 30 June 2023.
  • O'Carroll, Conor, Cecilia Cabello Valdés, Fulvio Esposito, Eeva Kaunismaa, Karen Maas, David McAllister, Janet Metcalfe, Bernard Rentier, and Karen Vandevelde (2017) Evaluation of Research Careers Fully Acknowledging Open Science Practices. Rewards, Incentives, and/or Recognition for Researchers Practising Open Science. Link: [https://op.europa.eu/en/publication-detail/-/publication/47a3a330-c9cb-11e7-8e69-01aa75ed71a1]. Accessed 30 June 2023.
  • Wilsdon, James, Judit Bar-Ilan, Robert Frodeman, Elisabeth Lex, Isabella Peters, and Paul Wouters (2017) Next-generation Metrics. Responsible Metrics and Evaluation for Open Science. Link: [https://op.europa.eu/en/publication-detail/-/publication/b858d952-0a19-11e7-8a35-01aa75ed71a1]. Accessed 30 June 2023.
  • Rossel, Christophe, Marta Dias Agostinho, Kristiina Hormia-Poutanen, Ernst Kristiansen, Rebecca Lawrence, Sabina Leonelli, Natalia Manola, Eva Méndez, and Michela Vignoli (2017) Recommendations of the OSPP on Next-Generation Metrics. Presentation by the Altmetrics Working Group of the Open Science Policy Platform (OSPP) in November 2017. Link: [https://ec.europa.eu/research-and-innovation/sites/default/files/rio/events/Next-Generation%2520Metrics__C.%2520Rossel%2520and%2520R.%2520Lawrence.pdf]. Accessed 30 June 2023.
  • Miedema, Frank, Kim Holmberg, Sabina Leonelli, and Katja Mayer (2018) Mutual Learning Exercise. Open Science. Altmetrics and Rewards. Link: [https://op.europa.eu/en/publication-detail/-/publication/449cc187-693f-11e8-ab9c-01aa75ed71a1]. Accessed 30 June 2023.
  • Webpage of the Open Science Monitor hosted by the European Commission. Link: [https://research-and-innovation.ec.europa.eu/strategy/strategy-2020-2024/our-digital-future/open-science/open-science-monitor/about-open-science-monitor_en]. Accessed 30 June 2023.
  • Wouters, Paul, Alis Oancea, Ismael Ràfols Garcia, James Holbrook, Merle Jacob, and Shina Caroline Lynn Kamerlin (2019) Indicator Frameworks for Fostering Open Knowledge Practices in Science and Scholarship. Link: [https://op.europa.eu/en/publication-detail/-/publication/b69944d4-01f3-11ea-8c1f-01aa75ed71a1]. Accessed 30 June 2023.
  • League of European Research Universities (LERU) (2022) A Pathway towards Multidimensional Academic Careers. A LERU Framework for the Assessment of Researchers. Link: [https://www.leru.org/publications/a-pathway-towards-multidimensional-academic-careers-a-leru-framework-for-the-assessment-of-researchers]. Accessed 30 June 2023.