Info: Zenodo’s user support line is staffed on regular business days between Dec 23 and Jan 5. Response times may be slightly longer than normal.

Published March 31, 2023 | Version v1
Report Open

Workflows Community Summit 2022: A Roadmap Revolution

Creators

  • 1. Oak Ridge National Laboratory
  • 2. Barcelona Supercomputing Center
  • 3. Agnostiq
  • 4. National Energy Research Scientific Computing Center
  • 5. Lawrence Livermore National Laboratory
  • 6. University of Tennessee
  • 7. University of Chicago
  • 8. The University of Manchester
  • 9. Rutgers University
  • 10. University of Illinois Urbana Champaign
  • 11. University of Utah
  • 12. Argonne National Laboratory
  • 13. University of San Diego
  • 14. ParTec AG
  • 15. University of Innsbruck
  • 16. TU Berlin
  • 17. AGH University
  • 18. NOAA
  • 19. University of Sa ̃o Paulo
  • 20. Entangled Networks
  • 21. University of Georgia
  • 22. University of Hawaii
  • 23. Egypt Japan University of Science and Technology
  • 24. University of Southern California
  • 25. University of Torino
  • 26. ELIXIR
  • 27. CWL
  • 28. Seqera Labs
  • 29. NCI Australia
  • 30. Michael J. Fox Foundation
  • 31. iDiv
  • 32. University of St Andrews
  • 33. HP Labs
  • 34. Simula Research Laboratory
  • 35. Univ. Jena
  • 36. GE Research
  • 37. Universidad Politécnica de Madrid
  • 38. Queen's University
  • 39. Los Alamos National Laboratory
  • 40. University of Melbourne
  • 41. Humboldt-Universität zu Berlin
  • 42. Hewlett Packard Enterprise
  • 43. Humboldt University
  • 44. Ludwig-Maximilian University Munich
  • 45. RIKEN
  • 46. University of Turin
  • 47. HPE
  • 48. Sano Centre for Personalized Computational Medicine
  • 49. University of Science and Technology AGH
  • 50. Brookhaven National Laboratory
  • 51. Agnostiq Inc.
  • 52. Lawrence Berkeley National Laboratory
  • 53. Inria
  • 54. Leibniz Supercomputing Centre
  • 55. Cyfronet AGH
  • 56. Utrecht University
  • 57. EPFL
  • 58. TU-Munich
  • 59. George Mason University
  • 60. University of Maryland
  • 61. University of Notre Dame
  • 62. Hewlett Packard Labs
  • 63. University of Warsaw
  • 64. Universidad de los Andes
  • 65. AGH University of Science and Technology
  • 66. Friedrich Schiller University

Description

Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing (often referred to as a computing continuum) and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enabling the publication of workflows and their associated products according to the FAIR principles.

This document reports on discussions and findings from the 2022 international edition of the Workflows Community Summit that took place on November 29 and 30, 2022.  The two-day summit included 106 participants, from a group of international researchers and developers (Australia, Austria, Belgium, Brazil, Canada, Colombia, Egypt, France, Germany, Italy, Japan, Netherlands, Norway, Poland, Spain, Switzerland, United Kingdom, United States) from distinct workflow management systems and users, and representatives from funding agencies and industry.

Files

Workflows_Community_Summit_2022.pdf

Files (4.3 MB)

Name Size Download all
md5:422bbcde87d160ccc23e45dfd7d6013d
4.3 MB Preview Download