D4.1: Report on technical guidance and examples for data processing and modularization

The ACT4CAP27 project addresses the increasing complexity of sustainability models by establishing the ACT4CAP27 Data and Model Portal, a shared IT infrastructure under Work Package 4 (WP4) in the following referred to as “Accelerator platform”. This portal facilitates modular, automated, and version-controlled data flows, supporting WP2 (sustainability coverage), WP3 (agro-food system models), WP5 (modeling infrastructure), and WP6 (EU agri-food policy assessments post-2027). The platform emphasizes automation, transparency, scalability, and interoperability, aligning with FAIR data principles to streamline data processing and model-based scenario analysis.
The technical pipeline integrates raw data from public or partner sources, stored and versioned in the Accelerator data repository using Data Version Control (DVC) alongside Git. Standardized scripts clean and transform data into model-ready formats, enabling execution on the Accelerator platform or externally, with outputs harmonized via the AgMIP template for interoperability. The Accelerator supports modularity, reproducibility, scalability, and seamless integration of new datasets and models. Version control ensures traceability, with DVC managing large datasets and Git handling code and metadata. The Accelerator allows flexible job flows, defining job sequences for automated processing, and supports a well-defined software stack for reproducible outcomes. The AgMIP template, evolving into the ACT4CAP27 template, ensures consistent model outputs, validated for downstream use. This infrastructure enables transparent, policy-relevant results for sustainability analysis and visualization. A comprehensive online documentation with use-cases is available here: https://accelerator.iiasa.ac.at/docs/act4cap27-usecase2.html

Funding acknowledgement

Funded by the European Union. Grant Agreement No. 101134874. Views and opinions expressed are those of the authors only and do not necessarily reflect those of the European Union or the European Commission. Neither the European Union nor the granting authority can be held responsible for them.

UK Research and Innovation Project Code: 10130119

Citation

Singh, R., Brouwer, A., Frank, S., & Havlik, P. (2025). D4.1: Report on technical guidance and examples for data processing and modularization. ACT4CAP27 Horizon Europe project Grant Agreement No. 101134874. https://doi.org/10.5281/zenodo.19695624 

Legal notice

This document was produced under the terms and conditions of Grant Agreement No. 101134874for the European Commission. It does not necessary reflect the view of the European Union and in no way anticipates the Commission’s future policy in this area. The European Commission is not liable for any consequence stemming from the reuse of this publication.

© ACT4CAP27, 2025

The reuse of this document is authorised under a Creative Commons Attribution 4.0 International (CC-BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/). This means that reuse is allowed provided appropriate credit is given and any changes are indicated.
For any use or reproduction of elements that are not owned by the BrightSpace consortium, permission may need to be sought directly from the respective right holders.

Project information

ACT4CAP27 Horizon Europe project Grant Agreement No. 101134874
https://cordis.europa.eu/project/id/101134874
CALL: Innovative governance, environmental observations and digital solutions in support of the Green Deal
WORK PROGRAMME Topic ID: HORIZON-CL6-2023-GOVERNANCE-01-2 Advancing analytical capacity and tools to support EU agri-food policies post 2027

ACT4CAP27 Project coordination: Wageningen Economic Research, The Hague, NL
Contact: act4cap27@wur.nl | Website: act4cap27.eu

Project duration: 1 March 2024 – 28 February 2029