Conference paper Open Access

Seamless Infrastructure Customisation and Performance Optimisation for Time-critical Services in Data Infrastructures

Koulouzis, Spiros; Martin, Paul; Carval, Thierry; Grenier, Baptiste; Judeau, Glenn; Heikkinen, Jani; Wang, Junchao; Zhou, Huan; Hu, Yang; De Laat, Cees; Zhao, Zhiming

The increasing volumes of data being produced, curated and made

available by research infrastructure (RI) initiatives in the environmental

science domain require services to optimise the delivery

and staging of data on behalf of investigators and other users of

scientific data. Specialised data services for managing data lifecycle,

for creating and delivering data products, and for customised data

processing, play a crucial role in RIs to serve their user communities.

We describe our experiences identifying the time-critical requirements

of environmental scientists making use of ICT research

support infrastructure. We present a microservice based infrastructure

optimisation suite called the Dynamic Real-time Infrastructure

Planner (DRIP). We provide a case study whereby DRIP is used

to optimise runtime service quality for a data subscription service

provided by the Euro-Argo RI using EGI FedCloud and EUDAT’s

B2SAFE service.

Files (1.6 MB)
Name Size
DataCloud-drip_SK-ZZ-V6.pdf
md5:51fc5edfc1d7301a068ef40c0f4eded5
1.6 MB Download
30
21
views
downloads
All versions This version
Views 3030
Downloads 2121
Data volume 33.8 MB33.8 MB
Unique views 2727
Unique downloads 2121

Share

Cite as