Working paper Open Access

Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -

Thomas Röblitz


JSON-LD (schema.org) Export

{
  "description": "<p>Sequencing projects, like the Aqua Genome project, generate vast amounts of data which is processed through dif-<br>\nferent work ows composed of several steps linked together. Currently, such workflows are often run manually on<br>\nlarge servers. With the increasing amount of raw data that approach is no longer feasible. The successful imple-<br>\nmentation of the project's goals requires 2-3 orders of magnitude scaling of computing, while achieving high reli-<br>\nability on and supporting ease-of-use of super computing resources at the same time. We describe two example<br>\nuse cases, the implementation challenges and constraints, the actual application enabling and report our ndings.</p>", 
  "license": "https://creativecommons.org/licenses/by/4.0/legalcode", 
  "creator": [
    {
      "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Thomas R\u00f6blitz"
    }
  ], 
  "headline": "Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -", 
  "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", 
  "datePublished": "2014-06-04", 
  "keywords": [
    "workflows, magnitude scaling"
  ], 
  "url": "https://zenodo.org/record/823031", 
  "contributor": [
    {
      "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Ole W. Saastad"
    }, 
    {
      "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Hans A. Eide"
    }, 
    {
      "affiliation": "Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Katerina Michalickova"
    }, 
    {
      "affiliation": "Center for Ecological and Evolutionary Synthesis, Department of Biosciences (CEES), University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Alexander Johan Nederbragt"
    }, 
    {
      "affiliation": "Center for Ecological and Evolutionary Synthesis, Department of Biosciences (CEES), University of Oslo, P.O. Box 1066, Blindern, 0316 Oslo, Norway", 
      "@type": "Person", 
      "name": "Bastiaan Star"
    }
  ], 
  "@context": "https://schema.org/", 
  "identifier": "https://doi.org/10.5281/zenodo.823031", 
  "@id": "https://doi.org/10.5281/zenodo.823031", 
  "@type": "ScholarlyArticle", 
  "name": "Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -"
}
25
10
views
downloads
All versions This version
Views 2525
Downloads 1010
Data volume 5.0 MB5.0 MB
Unique views 2424
Unique downloads 99

Share

Cite as