Journal article Open Access

Design and implementation of GXP make — A workflow system based on make

Taura, Kenjiro; Matsuzaki, Takuya; Miwa, Makoto; Kamoshida, Yoshikazu; Yokoyama, Daisaku; Dun, Nan; Shibata, Takeshi; Jun, Choi Sung; Tsujii, Jun'ichi


Citation Style Language JSON Export

{
  "DOI": "10.1016/j.future.2011.05.026", 
  "author": [
    {
      "family": "Taura, Kenjiro"
    }, 
    {
      "family": "Matsuzaki, Takuya"
    }, 
    {
      "family": "Miwa, Makoto"
    }, 
    {
      "family": "Kamoshida, Yoshikazu"
    }, 
    {
      "family": "Yokoyama, Daisaku"
    }, 
    {
      "family": "Dun, Nan"
    }, 
    {
      "family": "Shibata, Takeshi"
    }, 
    {
      "family": "Jun, Choi Sung"
    }, 
    {
      "family": "Tsujii, Jun'ichi"
    }
  ], 
  "issued": {
    "date-parts": [
      [
        2013, 
        2, 
        1
      ]
    ]
  }, 
  "abstract": "This paper describes the rational behind designing\nworkflow systems based on the Unix make by showing a number\nof idioms useful for workflows comprising many tasks. It also\ndemonstrates a specific design and implementation of such a\nworkflow system called GXP make. GXP make supports all\nthe features of GNU make and extends its platforms from\nsingle node systems to clusters, clouds, supercomputers, and\ndistributed systems. Interestingly, it is achieved by a very small\ncode base that does not modify GNU make implementation at\nall. While being not ideal for performance, it achieved a useful\nperformance and scalability of dispatching one million tasks in\napproximately 16,000 seconds (60 tasks per second, including\ndependence analysis) on an 8 core Intel Nehalem node. For\nreal applications, recognition and classification of protein-protein\ninteractions from biomedical texts on a supercomputer with more\nthan 8,000 cores are described.", 
  "title": "Design and implementation of GXP make \u2014 A workflow system based on make", 
  "type": "article-journal", 
  "id": "890130"
}
40
25
views
downloads
Views 40
Downloads 25
Data volume 21.1 MB
Unique views 40
Unique downloads 24

Share

Cite as