Working paper Open Access

Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -

Thomas Röblitz

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.823031</identifier>
      <creatorName>Thomas Röblitz</creatorName>
      <affiliation>Department for Research Computing, University Center for Information Technology (USIT), University of Oslo, P.O. Box 1059, Blindern, 0316 Oslo, Norway</affiliation>
    <title>Scaling of Biological Data Work ows to Large HPC Systems - A Case Study in Marine Genomics -</title>
    <subject>workflows, magnitude scaling</subject>
    <date dateType="Issued">2014-06-04</date>
  <resourceType resourceTypeGeneral="Text">Working paper</resourceType>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.823030</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;Sequencing projects, like the Aqua Genome project, generate vast amounts of data which is processed through dif-&lt;br&gt;
ferent work ows composed of several steps linked together. Currently, such workflows are often run manually on&lt;br&gt;
large servers. With the increasing amount of raw data that approach is no longer feasible. The successful imple-&lt;br&gt;
mentation of the project's goals requires 2-3 orders of magnitude scaling of computing, while achieving high reli-&lt;br&gt;
ability on and supporting ease-of-use of super computing resources at the same time. We describe two example&lt;br&gt;
use cases, the implementation challenges and constraints, the actual application enabling and report our ndings.&lt;/p&gt;</description>
      <funderName>European Commission</funderName>
      <funderIdentifier funderIdentifierType="Crossref Funder ID">10.13039/501100000780</funderIdentifier>
      <awardNumber awardURI="info:eu-repo/grantAgreement/EC/FP7/312763/">312763</awardNumber>
      <awardTitle>PRACE - Third Implementation Phase Project</awardTitle>
All versions This version
Views 2525
Downloads 1010
Data volume 5.0 MB5.0 MB
Unique views 2424
Unique downloads 99


Cite as