Published June 27, 2025 | Version v1
Conference proceeding Open

Latest Developments of the PUNCH4NFDI Compute and Storage Infrastructures

  • 1. ROR icon Karlsruhe Institute of Technology
  • 2. ROR icon Leibniz Institute for Astrophysics Potsdam
  • 3. Universität Bonn
  • 4. ROR icon Deutsches Elektronen-Synchrotron DESY
  • 5. Georg-August-Universität Göttingen
  • 6. ROR icon Thüringer Landessternwarte Tautenburg

Description

The PUNCH4NFDI consortium, funded by the German Research Foundation for an initial period of five years, gathers various physics communities - particle, astro-, astroparticle, hadron and nuclear physics - from different institutions embedded in the National Research Data Infrastructure initiative. The goal of PUNCH4NFDI is the establishment of FAIR data management solutions for the participating communities. The federated compute and storage infrastructures made available to the consortium, Compute4PUNCH and Storage4PUNCH, comprise a variety of heterogeneous compute and storage systems. The compute resources are managed by an overlay batch system and COBalD/TARDIS meta-schedulers. The TARDIS resource manager is responsible for the provisioning of resources and their integration in the overlay batch system based on HTCondor, while the COBalD resource balancer optimises the resource utilization by matching the actual demand for a given type of resources. The access to the resources is standardised using a token-based authentication and authorization infrastructure. The refreshment of short-lived access tokens is automated using the HTCondor Credential Manager and the MyToken service. Login nodes define single entry points to the federation, while the use of containers and the CERN Virtual Machine File System ensures a scalable provisioning of virtualized software environments. The latest developments are presented, including the access tokens management and the integration of Compute4PUNCH as a compute backend of the REANA analysis platform.

Files

proceedings-chep24-roland.pdf

Files (271.5 kB)

Name Size Download all
md5:5d3319240bcb88575532936b01a2f21c
271.5 kB Preview Download

Additional details

Funding

Deutsche Forschungsgemeinschaft
PUNCH4NFDI 460248186