Journal article Open Access

Design and implementation of GXP make — A workflow system based on make

Taura, Kenjiro; Matsuzaki, Takuya; Miwa, Makoto; Kamoshida, Yoshikazu; Yokoyama, Daisaku; Dun, Nan; Shibata, Takeshi; Jun, Choi Sung; Tsujii, Jun'ichi

Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="" xmlns:oai_dc="" xmlns:xsi="" xsi:schemaLocation="">
  <dc:creator>Taura, Kenjiro</dc:creator>
  <dc:creator>Matsuzaki, Takuya</dc:creator>
  <dc:creator>Miwa, Makoto</dc:creator>
  <dc:creator>Kamoshida, Yoshikazu</dc:creator>
  <dc:creator>Yokoyama, Daisaku</dc:creator>
  <dc:creator>Dun, Nan</dc:creator>
  <dc:creator>Shibata, Takeshi</dc:creator>
  <dc:creator>Jun, Choi Sung</dc:creator>
  <dc:creator>Tsujii, Jun'ichi</dc:creator>
  <dc:description>This paper describes the rational behind designing
workflow systems based on the Unix make by showing a number
of idioms useful for workflows comprising many tasks. It also
demonstrates a specific design and implementation of such a
workflow system called GXP make. GXP make supports all
the features of GNU make and extends its platforms from
single node systems to clusters, clouds, supercomputers, and
distributed systems. Interestingly, it is achieved by a very small
code base that does not modify GNU make implementation at
all. While being not ideal for performance, it achieved a useful
performance and scalability of dispatching one million tasks in
approximately 16,000 seconds (60 tasks per second, including
dependence analysis) on an 8 core Intel Nehalem node. For
real applications, recognition and classification of protein-protein
interactions from biomedical texts on a supercomputer with more
than 8,000 cores are described.</dc:description>
  <dc:title>Design and implementation of GXP make — A workflow system based on make</dc:title>
Views 39
Downloads 22
Data volume 18.6 MB
Unique views 39
Unique downloads 21


Cite as