Conference paper Open Access
Seamless Infrastructure Customisation and Performance Optimisation for Time-critical Services in Data Infrastructures
Koulouzis, Spiros;
Martin, Paul;
Carval, Thierry;
Grenier, Baptiste;
Judeau, Glenn;
Heikkinen, Jani;
Wang, Junchao;
Zhou, Huan;
Hu, Yang;
De Laat, Cees;
Zhao, Zhiming
The increasing volumes of data being produced, curated and made
available by research infrastructure (RI) initiatives in the environmental
science domain require services to optimise the delivery
and staging of data on behalf of investigators and other users of
scientific data. Specialised data services for managing data lifecycle,
for creating and delivering data products, and for customised data
processing, play a crucial role in RIs to serve their user communities.
We describe our experiences identifying the time-critical requirements
of environmental scientists making use of ICT research
support infrastructure. We present a microservice based infrastructure
optimisation suite called the Dynamic Real-time Infrastructure
Planner (DRIP). We provide a case study whereby DRIP is used
to optimise runtime service quality for a data subscription service
provided by the Euro-Argo RI using EGI FedCloud and EUDAT’s
B2SAFE service.
| Name | Size | |
|---|---|---|
|
DataCloud-drip_SK-ZZ-V6.pdf
md5:51fc5edfc1d7301a068ef40c0f4eded5 |
1.6 MB | Download |
| All versions | This version | |
|---|---|---|
| Views | 31 | 31 |
| Downloads | 22 | 22 |
| Data volume | 35.4 MB | 35.4 MB |
| Unique views | 28 | 28 |
| Unique downloads | 22 | 22 |
- Publication date:
- November 12, 2017
- DOI:
-
- Keyword(s):
- time-critical services, research infrastructure, virtual research environment, e-infrastructure, dynamic real-time infrastructure planner
- Grants:
-
European Commission:
-
VRE4EIC - A Europe-wide Interoperable Virtual Research Environment to Empower Multidisciplinary Research Communities and Accelerate Innovation and Collaboration (676247)
-
ENVRI PLUS - Environmental Research Infrastructures Providing Shared Solutions for Science and Society (654182)
- SWITCH - Software Workbench for Interactive, Time Critical and Highly self-adaptive cloud applications (643963)
-
VRE4EIC - A Europe-wide Interoperable Virtual Research Environment to Empower Multidisciplinary Research Communities and Accelerate Innovation and Collaboration (676247)
- Meeting:
- The Eighth International Workshop on Data-Intensive Computing in the Clouds, in the Context of IEEE Supercomputing 2017 (DataCloud17), Denver, 12, November 2017
- License (for files):
- Creative Commons Attribution 4.0 International