Scaling Scientific Workflows in Europe: Architecture and Deployment of the Galaxy-Pulsar Computational Network
Creators
-
Tangaro, Marco Antonio1
-
Nicotri, Stefano2
-
Grüning, Björn3
-
Srikakulam, Sanjay Kumar3
-
Dadras, Armin3
- Kaiser, Oana3
-
Kuntz, Mira3
-
Bretaudeau, Anthony4
-
De Geest, Paul5
-
Luna-Valero, Sebastian6
-
Chavero Díez, María7
-
Fernández González, José María7
-
Capella-Gutierrez, Salvador7
-
Gelpí, Josep Lluís7, 8
-
Astalos, Jan9
-
Jurič, Boris10
-
Ruda, Miroslav10, 11
-
Opioła, Łukasz12
-
Bayındır, Hakan13
-
GIOIOSA, SILVIA14
- De Sanctis, Gaetanomaria15
-
Zambelli, Federico16
- 1. Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche Bari Puglia ITi
- 2. Istituto Nazionale di Fisica Nucleare
-
3.
University of Freiburg
-
4.
Institut de Recherche en Informatique et Systèmes Aléatoires
-
5.
Vlaams Instituut voor Biotechnologie
-
6.
EGI Foundation
-
7.
Barcelona Supercomputing Center
- 8. University of Barcelona
- 9. Institute of Informatics, Slovak Academy of Sciences
-
10.
Czech Education and Scientific Network
-
11.
Masaryk University
-
12.
Akademickie Centrum Komputerowe Cyfronet AGH
-
13.
Turkish Academic Network and Information Center
- 14. Cineca Sede Roma
-
15.
University of Milan
- 16. Università degli Studi di Milano Dipartimento di Bioscienze
Contributors
Project members:
Researchers:
-
Nicotri, Stefano2
-
Srikakulam, Sanjay Kumar3
-
Kuntz, Mira3
-
Bretaudeau, Anthony4
-
De Geest, Paul5
-
Chavero Díez, María7
-
Fernández González, José María7
-
Capella-Gutierrez, Salvador7
-
Gelpí, Josep Lluís7, 8
-
Astalos, Jan9
-
Jurič, Boris10
-
Ruda, Miroslav10, 11
-
Opioła, Łukasz12
-
Bayındır, Hakan13
-
GIOIOSA, SILVIA14
- De Sanctis, Gaetanomaria15
-
Zambelli, Federico16
Work package leader:
- 1. Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche Bari Puglia ITi
- 2. Istituto Nazionale di Fisica Nucleare
-
3.
University of Freiburg
-
4.
Institut de Recherche en Informatique et Systèmes Aléatoires
-
5.
Vlaams Instituut voor Biotechnologie
-
6.
EGI Foundation
-
7.
Barcelona Supercomputing Center
- 8. University of Barcelona
- 9. Institute of Informatics, Slovak Academy of Sciences
-
10.
Czech Education and Scientific Network
-
11.
Masaryk University
-
12.
Akademickie Centrum Komputerowe Cyfronet AGH
-
13.
Turkish Academic Network and Information Center
- 14. Cineca Sede Roma
-
15.
University of Milan
- 16. Università degli Studi di Milano Dipartimento di Bioscienze
Description
This preprint outlines the development and deployment of the European Pulsar Network (EPN)—a federated, scalable architecture enabling distributed job execution across national and European Galaxy instances. Built within the Horizon Europe EuroScienceGateway project, the EPN leverages the Galaxy workflow system and the Pulsar job execution service to offload computational workloads to remote endpoints seamlessly and securely. The work introduces an Open Infrastructure (OI) framework that automates provisioning, deployment, and monitoring using Terraform, Ansible, and Jenkins. The pre-print highlights deployments across thirteen Pulsar nodes and six national Galaxy portals, illustrating how the EPN supports reproducible, FAIR-aligned data analysis while abstracting infrastructure complexity for researchers.
Files
European_Pulsar_Network_manuscript.pdf
Files
(3.4 MB)
Name | Size | Download all |
---|---|---|
md5:e0f115a0a9f11ccb5318333b538009fc
|
3.4 MB | Preview Download |
Additional details
Funding
- European Commission
- EuroScienceGateway - leveraging the European compute infrastructures for data-intensive research guided by FAIR principles 101057388
- UK Research and Innovation
- EuroScienceGateway: leveraging the European compute infrastructures for data-intensive research guided by FAIR principles 10038963
Dates
- Submitted
-
2025-08-07