There is a newer version of this record available.

Working paper Open Access

Introducing Parsl: A Python Parallel Scripting Library

Babuji, Yadu; Brizius, Alison; Chard, Kyle; Foster, Ian; Katz, Daniel S.; Wilde, Michael; Wozniak, Justin


JSON Export

{
  "conceptdoi": "10.5281/zenodo.853491", 
  "conceptrecid": "853491", 
  "created": "2017-08-30T01:06:07.596489+00:00", 
  "doi": "10.5281/zenodo.853492", 
  "id": 853492, 
  "links": {
    "badge": "https://zenodo.org/badge/doi/10.5281/zenodo.853492.svg", 
    "conceptbadge": "https://zenodo.org/badge/doi/10.5281/zenodo.853491.svg", 
    "conceptdoi": "https://doi.org/10.5281/zenodo.853491", 
    "doi": "https://doi.org/10.5281/zenodo.853492"
  }, 
  "metadata": {
    "access_right": "open", 
    "access_right_category": "success", 
    "communities": [
      {
        "id": "zenodo"
      }
    ], 
    "creators": [
      {
        "affiliation": "University of Chicago", 
        "name": "Babuji, Yadu"
      }, 
      {
        "affiliation": "University of Chicago", 
        "name": "Brizius, Alison"
      }, 
      {
        "affiliation": "University of Chicago", 
        "name": "Chard, Kyle"
      }, 
      {
        "affiliation": "Argonne National Laboratory", 
        "name": "Foster, Ian"
      }, 
      {
        "affiliation": "University of Illinois Urbana-Champaign,", 
        "name": "Katz, Daniel S."
      }, 
      {
        "affiliation": "Argonne National Laboratory", 
        "name": "Wilde, Michael"
      }, 
      {
        "affiliation": "Argonne National Laboratory", 
        "name": "Wozniak, Justin"
      }
    ], 
    "description": "<p>Researchers frequently rely on large-scale and domain-specific workflows to conduct their science. These workflows\u00a0may integrate a variety of independent software functions and external applications. However, developing and executing such workflows can be difficult, requiring complex orchestration\u00a0and management of applications and data as well as customization\u00a0for specific execution environments. Parsl (Parallel Scripting\u00a0Library), a Python library for programming and executing data-oriented workflows in parallel, addresses these problems. Developers simply annotate a Python script with Parsl directives;\u00a0Parsl manages the execution of the script on clusters, clouds,\u00a0grids, and other resources. Parsl orchestrates required data movement and manages the execution of Python functions and\u00a0external applications in parallel. In this abstract we describe\u00a0Parsl\u2019s architecture and highlight two domains in which it has\u00a0been used.</p>", 
    "doi": "10.5281/zenodo.853492", 
    "keywords": [
      "Parallel scripting", 
      "Parsl", 
      "Python"
    ], 
    "license": {
      "id": "CC-BY-4.0"
    }, 
    "publication_date": "2017-08-30", 
    "related_identifiers": [
      {
        "identifier": "10.5281/zenodo.853491", 
        "relation": "isPartOf", 
        "scheme": "doi"
      }
    ], 
    "relations": {
      "version": [
        {
          "count": 2, 
          "index": 0, 
          "is_last": false, 
          "last_child": {
            "pid_type": "recid", 
            "pid_value": "891533"
          }, 
          "parent": {
            "pid_type": "recid", 
            "pid_value": "853491"
          }
        }
      ]
    }, 
    "resource_type": {
      "subtype": "workingpaper", 
      "title": "Working paper", 
      "type": "publication"
    }, 
    "title": "Introducing Parsl: A Python Parallel Scripting Library"
  }, 
  "owners": [
    35388
  ], 
  "revision": 4, 
  "updated": "2017-09-15T01:43:39.124471+00:00"
}

Share

Cite as