Conference paper Open Access

Linking provenance with system logs: a context aware information integration and exploration framework for analyzing workflow execution

el Khaldi Ahanach, Elias; Koulouzis, Spiros; Zhao, Zhiming


Citation Style Language JSON Export

{
  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.3466766", 
  "title": "Linking provenance with system logs: a context aware information integration and exploration framework for analyzing workflow execution", 
  "issued": {
    "date-parts": [
      [
        2019, 
        10, 
        1
      ]
    ]
  }, 
  "abstract": "<p>When executing scientific workflows in a distributed</p>\n\n<p>environment, anomalies of the workflow behavior are often</p>\n\n<p>caused by a mixture of different issues, e.g., careless design</p>\n\n<p>of the workflow logic, buggy workflow components, unexpected</p>\n\n<p>performance bottlenecks or resource failure at the underlying</p>\n\n<p>infrastructure. The provenance information only defines data</p>\n\n<p>evolution at the workflow level, which does not have an explicit</p>\n\n<p>connection with the system logs provided by the underlying</p>\n\n<p>infrastructure. Analyzing provenance information and apposite</p>\n\n<p>system metrics requires expertise and a considerable amount of</p>\n\n<p>manual effort. Moreover, it is often time-consuming to aggregate</p>\n\n<p>this information and correlate events occurring at different levels</p>\n\n<p>in the infrastructure. In this paper, we propose an architecture</p>\n\n<p>to automate the integration among the workflow provenance</p>\n\n<p>information with the performance information collected from</p>\n\n<p>infrastructure nodes running workflow tasks. Our architecture</p>\n\n<p>enables workflow developers or domain scientists to effectively</p>\n\n<p>browse workflow execution information together with the system</p>\n\n<p>metrics, and analyze contextual information for possible anomalies.</p>", 
  "author": [
    {
      "family": "el Khaldi Ahanach, Elias"
    }, 
    {
      "family": "Koulouzis, Spiros"
    }, 
    {
      "family": "Zhao, Zhiming"
    }
  ], 
  "id": "3466766", 
  "event-place": "Ljubljana, Slovenia", 
  "version": "Camera ready", 
  "type": "paper-conference", 
  "event": "11th International Workshop on Science Gateways (IWSG19)"
}
109
27
views
downloads
All versions This version
Views 109109
Downloads 2727
Data volume 17.1 MB17.1 MB
Unique views 107107
Unique downloads 2727

Share

Cite as