D6.4 Copernicus Data Pipelines Report

In this document we will present the Copernicus Earth Observation Data Pipeline as an integrated intermediate service layer for the systematic execution of Earth Observation Applications continuously delivering data and information to users. A data pipeline is the solution provided to a specific data challenge defined by a researcher as a tailored data processing workflow responsible for information extraction from a wide range of large volume Earth observation data sources that are executed within defined spatial and temporal intervals. The Data Pipeline uses shared data processing infrastructures from EOSC where the EarthObservation applications are deployed, providing a hybrid and reliable Cloud infrastructure for the applications needs. The service deployment follows the best practice to package and deploy applications as reproducible, deployable and executable in different platforms. Terradue Ellip Platform manages the underlying Cloud resources provided from EOSC, orchestrates the execution of the triggered Data Pipelines and publishes the results.

This report documents the design of Copernicus Data Pipelines and the implementation and deployment activities performed responding to RELIANCE users challenges. During this 1st year of the project, the activities focused on INGV's Grand Challenge 4 preparing the response to Scenario 1 (analysing the consequences of large volcanic eruptions) and Scenario 2 (developing models and creating a new specific workflow to analyse SAR data).