Sharing Nextflow code across organizations using the nf-core infrastructure
Authors/Creators
Description
Context
This zenodo archive contains information regarding the project titled "Sharing Nextflow code across organizations using the nf-core infrastructure", the project was performed as part of the first cohort of the Future Innovators programme of the Wellcome Sanger Institute. The project was presented in poster format at the Genome Informatics conference between the 13th and 15th of November, 2024.
Resources
- GitHub project containing tasks, issues and pull requests made as part of the project: https://github.com/orgs/sanger-tol/projects/9/
- Draft documentation for the feature
- The Future Innovators mentorship programme
Abstract (English)
nf-core (https://nf-co.re/) is a community of hundreds of bioinformaticians promoting and supporting the development of bioinformatics pipelines in the Nextflow language. They provide infrastructure and tooling for constructing, hosting, and using, the components of pipelines, which are called modules and sub-workflows, in an efficient and reliable manner. The nf-core organization on GitHub contains a central repository of ready-to-use modules and sub-workflows, which is open-source and co-developed by the wider community.
The nf-core community maintains a software suite that enables the creation of data pipelines, leveraging on this infrastructure. In particular, a command-line tool facilitates the incorporation of pre-built code, modules and sub-workflows, into them. The command-line tool, however, restricts users from using components that are built across multiple modules / sub-workflows repositories. This limitation hinders the adoption of Nextflow and nf-core in organizations that cannot deposit all their modules and sub-workflows in the nf-core repository. In this work, we aim to facilitate the incorporation of sub-workflows built across repositories and organizations, further enabling collaborative efforts. By extending the YAML metadata already present in sub-workflows, we, in collaboration with the nf-core community, implemented a new feature for the tool that makes it possible for users to build these components. This new feature makes it possible for multiple institutions to reuse the same, well-tested Nextflow code, but still be able to build upon it and make their own modifications with ease.
Notes (English)
Files
GI - Ferreira Cavalcante, João Vitor_Poster.pdf
Files
(1.5 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:3a5fbf1eea9bb6a9947aa4a33da38650
|
492.5 kB | Preview Download |
|
md5:cd680a5ffd9f0851b08bbbad9a55f887
|
1.0 MB | Preview Download |
Additional details
Additional titles
- Alternative title (English)
- Module and sub-workflow sharing in nf-core
Software
- Repository URL
- https://github.com/nf-core/tools
- Programming language
- Python , Nextflow
- Development Status
- Active