Published October 22, 2025
| Version v1
Presentation
Open
workflow-installer: Simplifying Nextflow Workflow Deployment on HPC Clusters
Description
Nextflow workflows are widely used in bioinformatics, but deploying them on shared HPC clusters can be complex. Cluster environments often require fine-tuned configurations, and systems with restricted internet access necessitate time-consuming offline preparation of workflow dependencies, such as container images and offline-ready configuration files. These challenges impede workflow adoption on HPC clusters.
We present workflow-installer, a lightweight framework that can be used to centrally deploy versioned Nextflow pipelines as environment modules with configurations optimised for specific HPC clusters. An installer script created for each workflow automates tasks such as pulling workflow source code, applying patches for offline execution, retrieving Singularity container images, downloading test datasets, configuring a script for registering workflow on Seqera platform, copying cluster-specific configurations and documentation, and generating modulefiles. workflow-installer includes several helper functions for creating reproducible, robust installation scripts (e.g., caching sources, transforming container URIs).
After deployment, users can load a workflow with module load / and execute it completely offline with cluster-specific optimisations. Using the pre-downloaded test datasets and example commands in the documentation, users can validate installations with minimal effort. The workflow can also be registered on the Seqera platform using the preconfigured script. Users experience virtually zero setup time and benefit from improved performance due to tailored configurations.
workflow-installer lowers the barrier to using Nextflow workflows on HPC, enabling more reproducible and efficient bioinformatics analyses. By shifting workflow setup to a single module load, researchers focus on science rather than infrastructure, making HPC resources more accessible to the life sciences community.
Files
Null_89.txt
Files
(81 Bytes)
| Name | Size | Download all |
|---|---|---|
|
md5:4e1a42f460583a4d97552753d39b4d89
|
81 Bytes | Preview Download |