Journal article Open Access

Design and implementation of GXP make — A workflow system based on make

Taura, Kenjiro; Matsuzaki, Takuya; Miwa, Makoto; Kamoshida, Yoshikazu; Yokoyama, Daisaku; Dun, Nan; Shibata, Takeshi; Jun, Choi Sung; Tsujii, Jun'ichi


DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://datacite.org/schema/kernel-4" xsi:schemaLocation="http://datacite.org/schema/kernel-4 http://schema.datacite.org/meta/kernel-4.1/metadata.xsd">
  <identifier identifierType="URL">https://zenodo.org/record/890130</identifier>
  <creators>
    <creator>
      <creatorName>Taura, Kenjiro</creatorName>
      <givenName>Kenjiro</givenName>
      <familyName>Taura</familyName>
    </creator>
    <creator>
      <creatorName>Matsuzaki, Takuya</creatorName>
      <givenName>Takuya</givenName>
      <familyName>Matsuzaki</familyName>
    </creator>
    <creator>
      <creatorName>Miwa, Makoto</creatorName>
      <givenName>Makoto</givenName>
      <familyName>Miwa</familyName>
    </creator>
    <creator>
      <creatorName>Kamoshida, Yoshikazu</creatorName>
      <givenName>Yoshikazu</givenName>
      <familyName>Kamoshida</familyName>
    </creator>
    <creator>
      <creatorName>Yokoyama, Daisaku</creatorName>
      <givenName>Daisaku</givenName>
      <familyName>Yokoyama</familyName>
    </creator>
    <creator>
      <creatorName>Dun, Nan</creatorName>
      <givenName>Nan</givenName>
      <familyName>Dun</familyName>
    </creator>
    <creator>
      <creatorName>Shibata, Takeshi</creatorName>
      <givenName>Takeshi</givenName>
      <familyName>Shibata</familyName>
    </creator>
    <creator>
      <creatorName>Jun, Choi Sung</creatorName>
      <givenName>Choi Sung</givenName>
      <familyName>Jun</familyName>
    </creator>
    <creator>
      <creatorName>Tsujii, Jun'ichi</creatorName>
      <givenName>Jun'ichi</givenName>
      <familyName>Tsujii</familyName>
    </creator>
  </creators>
  <titles>
    <title>Design and implementation of GXP make — A workflow system based on make</title>
  </titles>
  <publisher>Zenodo</publisher>
  <publicationYear>2013</publicationYear>
  <dates>
    <date dateType="Issued">2013-02-01</date>
  </dates>
  <resourceType resourceTypeGeneral="Text">Journal article</resourceType>
  <alternateIdentifiers>
    <alternateIdentifier alternateIdentifierType="url">https://zenodo.org/record/890130</alternateIdentifier>
  </alternateIdentifiers>
  <relatedIdentifiers>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsIdenticalTo">10.1016/j.future.2011.05.026</relatedIdentifier>
  </relatedIdentifiers>
  <rightsList>
    <rights rightsURI="http://creativecommons.org/licenses/by-sa/4.0/legalcode">Creative Commons Attribution Share Alike 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
  </rightsList>
  <descriptions>
    <description descriptionType="Abstract">This paper describes the rational behind designing
workflow systems based on the Unix make by showing a number
of idioms useful for workflows comprising many tasks. It also
demonstrates a specific design and implementation of such a
workflow system called GXP make. GXP make supports all
the features of GNU make and extends its platforms from
single node systems to clusters, clouds, supercomputers, and
distributed systems. Interestingly, it is achieved by a very small
code base that does not modify GNU make implementation at
all. While being not ideal for performance, it achieved a useful
performance and scalability of dispatching one million tasks in
approximately 16,000 seconds (60 tasks per second, including
dependence analysis) on an 8 core Intel Nehalem node. For
real applications, recognition and classification of protein-protein
interactions from biomedical texts on a supercomputer with more
than 8,000 cores are described.</description>
  </descriptions>
</resource>
27
15
views
downloads
Views 27
Downloads 15
Data volume 12.7 MB
Unique views 27
Unique downloads 14

Share

Cite as