Conference paper Open Access

Contextual linking between workflow provenance and system performance logs

Ahanach, Elias el Khaldi; Koulouzis, Spiros; Zhao, Zhiming

When executing scientific workflows, anomalies of

the workflow behavior are often caused by different issues such

as resource failures at the underlying infrastructure. The provenance

information collected by workflow management systems

only captures the transformation of data at the workflow level.

Analyzing provenance information and apposite system metrics

requires expertise and manual effort. Moreover, it is often timeconsuming

to aggregate this information and correlate events

occurring at different levels of the infrastructure. In this paper,

we propose an architecture to automate the integration among

workflow provenance information and performance information

from the infrastructure level. Our architecture enables workflow

developers or domain scientists to effectively browse workflow

execution information together with the system metrics, and

analyze contextual information for possible anomalies.

Files (306.9 kB)
Name Size
2019.conference.escience-poster-1.provenance.camera.pdf
md5:5e14919da7f87d0d9755217f44efebfe
306.9 kB Download
23
12
views
downloads
Views 23
Downloads 12
Data volume 3.7 MB
Unique views 22
Unique downloads 10

Share

Cite as