Published October 18, 2023 | Version v1
Presentation Open

Visible & reusable workflows

Authors/Creators

  • 1. Australian BioCommons

Description

Computational workflows are absolutely critical to contemporary science, particularly in bioinformatics, which requires complex multistep analyses to draw meaning from data. Workflows exist on a spectrum ranging from heterogeneous composites of code - in bash scripts and interactive notebooks - that are often modified on-the-fly for bespoke or interactive analyses - through to production level pipelines managed by a workflow management system that enable portability, reproducibility and robustness across multiple computational infrastructures. Regardless of where a workflow sits on this spectrum, its development requires expertise and time to be invested in the build, testing, and documentation, as well as deployment and optimisation for target computational infrastructure. This investment increases as a workflow moves towards a mature production level artefact. This importance, complexity and the cost of creation underpins the need to make workflows FAIR (findable, accessible, interoperable and reusable), but also to make sure they are visible, first class digital outputs of research. In this presentation, we will describe the ecosystem of platforms, services and practices that can be leveraged by workflow developers to make their work visible, FAIR, and citable. We will also highlight the role that e-infrastructures play in supporting this ecosystem, by integrating best practice community standards for workflow description, annotation and execution with the reality of deploying workflows to a heterogeneous network of institutional and national computational endpoints. Examples of this include adopting Galaxy and Nextflow community best practices, collaborating directly with registries like WorkflowHub, and supporting enabling services for Australia: Galaxy and Nextflow Tower.

Files

Null.txt

Files (81 Bytes)

Name Size Download all
md5:4e1a42f460583a4d97552753d39b4d89
81 Bytes Preview Download