EXTRACT-TASKA: A Distributed Workflow Orchestrator for Radio Astronomy Data Processing
Authors/Creators
- 1. Observatoire de Paris, Université de Recherche Paris Sciences et Lettres
-
2.
Laboratoire d'études spatiales et d'instrumentation en astrophysique
-
3.
Université Paris Cité
-
4.
Observatoire de Paris
- 5. Ekinox
- 6. PSL universite
- 7. CNRS Délégation Paris B
- 8. Barcelona Supercomputing Center
Description
We present the distributed workflow orchestrator framework developed within the EXTRACT project, for the TASKA (Transients Astrophysics with and SKA pathfinder). The orchestrator is built on existing software developed and maintained by the partner of the EXTRACT project. We demonstrate that a simple workflow for radio astronomy interferometric imaging can be run with this framework, using various cloud infrastructures. It has been tested with a private cloud provider (OVH), as well as on academic cloud infrastructures (EGI/CESNET, EOSC EU Node, ObsParis local OKD cluster). The demonstration can run from a jupyter notebook (e.g., on the EOSC EU Node), and the processing is run remotely on the selected cloud infrastructure.
Notes (En)
The presentation was given to the OAEG4 group on Nov. 25th 2025.
The attached videos show:
demo-eosc-eu-node.mp4: a demo running on the EOSC EU Node Jupyter Notebook service, with the actual data processing running on OVH.demo-okd-eosc.mp4: a demo running on a local laptop, with the actual data processing running on the EOSC EU Node cloud computing service (OKD instance).
The EXTRACT project has received funding from the European Union’s Horizon Europe programme under grant agreement number 101093110.