Published August 7, 2025 | Version 1
Preprint Open

Scaling Scientific Workflows in Europe: Architecture and Deployment of the Galaxy-Pulsar Computational Network

  • 1. Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche Bari Puglia ITi
  • 2. Istituto Nazionale di Fisica Nucleare
  • 3. ROR icon University of Freiburg
  • 4. ROR icon Institut de Recherche en Informatique et Systèmes Aléatoires
  • 5. ROR icon Vlaams Instituut voor Biotechnologie
  • 6. EDMO icon EGI Foundation
  • 7. ROR icon Barcelona Supercomputing Center
  • 8. University of Barcelona
  • 9. Institute of Informatics, Slovak Academy of Sciences
  • 10. ROR icon Czech Education and Scientific Network
  • 11. ROR icon Masaryk University
  • 12. ROR icon Akademickie Centrum Komputerowe Cyfronet AGH
  • 13. ROR icon Turkish Academic Network and Information Center
  • 14. Cineca Sede Roma
  • 15. ROR icon University of Milan
  • 16. Università degli Studi di Milano Dipartimento di Bioscienze
  • 1. Istituto di Biomembrane Bioenergetica e Biotecnologie Molecolari Consiglio Nazionale delle Ricerche Bari Puglia ITi
  • 2. Istituto Nazionale di Fisica Nucleare
  • 3. ROR icon University of Freiburg
  • 4. ROR icon Institut de Recherche en Informatique et Systèmes Aléatoires
  • 5. ROR icon Vlaams Instituut voor Biotechnologie
  • 6. EDMO icon EGI Foundation
  • 7. ROR icon Barcelona Supercomputing Center
  • 8. University of Barcelona
  • 9. Institute of Informatics, Slovak Academy of Sciences
  • 10. ROR icon Czech Education and Scientific Network
  • 11. ROR icon Masaryk University
  • 12. ROR icon Akademickie Centrum Komputerowe Cyfronet AGH
  • 13. ROR icon Turkish Academic Network and Information Center
  • 14. Cineca Sede Roma
  • 15. ROR icon University of Milan
  • 16. Università degli Studi di Milano Dipartimento di Bioscienze

Description

This preprint outlines the development and deployment of the European Pulsar Network (EPN)—a federated, scalable architecture enabling distributed job execution across national and European Galaxy instances. Built within the Horizon Europe EuroScienceGateway project, the EPN leverages the Galaxy workflow system and the Pulsar job execution service to offload computational workloads to remote endpoints seamlessly and securely. The work introduces an Open Infrastructure (OI) framework that automates provisioning, deployment, and monitoring using Terraform, Ansible, and Jenkins. The pre-print highlights deployments across thirteen Pulsar nodes and six national Galaxy portals, illustrating how the EPN supports reproducible, FAIR-aligned data analysis while abstracting infrastructure complexity for researchers.

Files

European_Pulsar_Network_manuscript.pdf

Files (3.4 MB)

Name Size Download all
md5:e0f115a0a9f11ccb5318333b538009fc
3.4 MB Preview Download

Additional details

Funding

European Commission
EuroScienceGateway - leveraging the European compute infrastructures for data-intensive research guided by FAIR principles 101057388
UK Research and Innovation
EuroScienceGateway: leveraging the European compute infrastructures for data-intensive research guided by FAIR principles 10038963

Dates

Submitted
2025-08-07