Conference paper Open Access

Linking provenance with system logs: a context aware information integration and exploration framework for analyzing workflow execution

el Khaldi Ahanach, Elias; Koulouzis, Spiros; Zhao, Zhiming


JSON-LD (schema.org) Export

{
  "description": "<p>When executing scientific workflows in a distributed</p>\n\n<p>environment, anomalies of the workflow behavior are often</p>\n\n<p>caused by a mixture of different issues, e.g., careless design</p>\n\n<p>of the workflow logic, buggy workflow components, unexpected</p>\n\n<p>performance bottlenecks or resource failure at the underlying</p>\n\n<p>infrastructure. The provenance information only defines data</p>\n\n<p>evolution at the workflow level, which does not have an explicit</p>\n\n<p>connection with the system logs provided by the underlying</p>\n\n<p>infrastructure. Analyzing provenance information and apposite</p>\n\n<p>system metrics requires expertise and a considerable amount of</p>\n\n<p>manual effort. Moreover, it is often time-consuming to aggregate</p>\n\n<p>this information and correlate events occurring at different levels</p>\n\n<p>in the infrastructure. In this paper, we propose an architecture</p>\n\n<p>to automate the integration among the workflow provenance</p>\n\n<p>information with the performance information collected from</p>\n\n<p>infrastructure nodes running workflow tasks. Our architecture</p>\n\n<p>enables workflow developers or domain scientists to effectively</p>\n\n<p>browse workflow execution information together with the system</p>\n\n<p>metrics, and analyze contextual information for possible anomalies.</p>", 
  "license": "https://creativecommons.org/licenses/by/4.0/legalcode", 
  "creator": [
    {
      "affiliation": "University of Amsterdam", 
      "@type": "Person", 
      "name": "el Khaldi Ahanach, Elias"
    }, 
    {
      "affiliation": "University of Amsterdam", 
      "@type": "Person", 
      "name": "Koulouzis, Spiros"
    }, 
    {
      "affiliation": "University of Amsterdam", 
      "@id": "https://orcid.org/0000-0002-6717-9418", 
      "@type": "Person", 
      "name": "Zhao, Zhiming"
    }
  ], 
  "headline": "Linking provenance with system logs: a context aware information integration and exploration framework for analyzing workflow execution", 
  "image": "https://zenodo.org/static/img/logos/zenodo-gradient-round.svg", 
  "datePublished": "2019-10-01", 
  "url": "https://zenodo.org/record/3466766", 
  "version": "Camera ready", 
  "@type": "ScholarlyArticle", 
  "@context": "https://schema.org/", 
  "identifier": "https://doi.org/10.5281/zenodo.3466766", 
  "@id": "https://doi.org/10.5281/zenodo.3466766", 
  "workFeatured": {
    "url": "http://www.iwsg2019.eu", 
    "alternateName": "IWSG19", 
    "location": "Ljubljana, Slovenia", 
    "@type": "Event", 
    "name": "11th International Workshop on Science Gateways"
  }, 
  "name": "Linking provenance with system logs: a context aware information integration and exploration framework for analyzing workflow execution"
}
115
27
views
downloads
All versions This version
Views 115115
Downloads 2727
Data volume 17.1 MB17.1 MB
Unique views 112112
Unique downloads 2727

Share

Cite as