Working paper Open Access
Thomas Röblitz
{ "description": "<p>Sequencing projects, like the Aqua Genome project, generate vast amounts of data which is processed through dif-<br>\nferent work ows composed of several steps linked together. Currently, such workflows are often run manually on<br>\nlarge servers. With the increasing amount of raw data that approach is no longer feasible. The successful imple-<br>\nmentation of the project's goals requires 2-3 orders of magnitude scaling of computing, while achieving high reli-<br>\nability on and supporting ease-of-use of super computing resources at the same time. We describe two example<br>\nuse cases, the implementation challenges and constraints, the actual application enabling and report our ndings.</p>", "license": "https://creativecommons.org/licenses/by/4.0/legalcode", "creator": [ { "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Thomas R\u00f6blitz" } ], "headline": "Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -", "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", "datePublished": "2014-06-04", "keywords": [ "workflows, magnitude scaling" ], "url": "https://zenodo.org/record/823031", "contributor": [ { "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Ole W. Saastad" }, { "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Hans A. Eide" }, { "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Katerina Michalickova" }, { "affiliation": "Center for Ecological and Evolutionary Synthesis, Department of Biosciences (CEES), University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Alexander Johan Nederbragt" }, { "affiliation": "Center for Ecological and Evolutionary Synthesis, Department of Biosciences (CEES), University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway", "@type": "Person", "name": "Bastiaan Star" } ], "@context": "https://schema.org/", "identifier": "https://doi.org/10.5281/zenodo.823031", "@id": "https://doi.org/10.5281/zenodo.823031", "@type": "ScholarlyArticle", "name": "Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -" }
All versions | This version | |
---|---|---|
Views | 40 | 40 |
Downloads | 20 | 20 |
Data volume | 10.1 MB | 10.1 MB |
Unique views | 39 | 39 |
Unique downloads | 19 | 19 |