3901545
doi
10.5281/zenodo.3901545
oai:zenodo.org:3901545
user-is-enes3
user-eu
Spinuso, Alessandro
KNMI
Klampanos, Iraklis
NCSR-D
Atkinson, Malcom
EPCC
Maarten Plieger
KNMI
Wim Som de Cerff
KNMI
Vangelis Karkaletsis
NCSR-D
Integrating e-infrastructures for remote climate data processing
Pagé, Christian
CERFACS
info:eu-repo/semantics/openAccess
Creative Commons Attribution 4.0 International
https://creativecommons.org/licenses/by/4.0/legalcode
<p>Presented at EGU 2020 - Accessing and processing large climate data has nowadays become a particularly challenging task for end users, due to the rapidly increasing volumes being produced and made available. Access to climate data is crucial for sustaining research and performing climate change impact assessments. These activities have strong societal impact as climate change affects and requires that almost all economic and social sectors need adapting.</p>
<p>The whole climate data archive is expected to reach a volume of 30 PB in 2020 and up to 2000 PB in 2024 (estimated), evolving from 0.03 PB (30 TB) in 2007 and 2 PB in 2014. Data processing and analysis must now take place remotely for the users: users typically have to rely on heterogeneous infrastructures and services between the data and their physical location. Developers of Research Infrastructures have to provide services to those users, hence having to define standards and generic services to fulfil those requirements.</p>
<p>It will be shown how the DARE eScience Platform (<a href="http://project-dare.eu/">http://project-dare.eu</a>) will help developers to develop needed services more quickly and transparently for a large range of scientific researchers. The platform is designed for efficient and traceable development of complex experiments and domain-specific services. Most importantly, the DARE Platform integrates the following e-infrastructure services: the climate IS-ENES (<a href="https://is.enes.org/">https://is.enes.org</a>) Research Infrastructure front-end climate4impact (C4I: <a href="https://climate4impact.eu/">https://climate4impact.eu</a>), the EUDAT CDI (<a href="https://www.eudat.eu/eudat-collaborative-data-infrastructure-cdi">https://www.eudat.eu/eudat-collaborative-data-infrastructure-cdi</a>) B2DROP Service, as well as the ESGF (<a href="https://esgf.llnl.gov/">https://esgf.llnl.gov</a>). The DARE Platform itself can be deployed by research communities on local, public or commercial clouds, thanks to its containerized architecture.</p>
<p>More specifically, two distinct Use Cases for the climate science domain will be presented. The first will show how an open source software to compute climate indices and indicators (icclim: <a href="https://github.com/cerfacs-globc/icclim">https://github.com/cerfacs-globc/icclim</a>) is leveraged using the DARE Platform to enable users to build their own workflows. The second Use Case will demonstrate how more complex tools, such as an extra-tropical and tropical cyclone tracking software (<a href="https://github.com/cerfacs-globc/cyclone_tracking">https://github.com/cerfacs-globc/cyclone_tracking</a>), can be easily made available to end users by infrastructure and front-end software developers.</p>
<p> </p>
Zenodo
2020-05-08
info:eu-repo/semantics/lecture
3901544
user-is-enes3
user-eu
award_title=Delivering Agile Research Excellence on European e-Infrastructures; award_number=777413; award_identifiers_scheme=url; award_identifiers_identifier=https://cordis.europa.eu/projects/777413; funder_id=00k4n6c32; funder_name=European Commission;
award_title=Infrastructure for the European Network for Earth System modelling - Phase 3; award_number=824084; award_identifiers_scheme=url; award_identifiers_identifier=https://cordis.europa.eu/projects/824084; funder_id=00k4n6c32; funder_name=European Commission;
1592605102.697843
26379980
md5:af51b3e12b737281a1d72e2aaca78e48
https://zenodo.org/records/3901545/files/EGU_2020_CPAGE_DARE.pdf
public
10.5281/zenodo.3901544
isVersionOf
doi