Presentation Open Access

The Ghost of Performance Reproducibility Past

Ramesh, Srinivasan; Titov, Mikhail; Turilli, Matteo; Jha, Shantenu; Malony, Allen

The importance of ensemble computing is well established. However, executing ensembles at scale introduces interesting performance fluctuations that have not been well investigated. In this paper, we trace our experience uncovering performance fluctuations of ensemble applications (primarily constituting a workflow of GROMACS tasks), and unsuccessful attempts, so far, at trying to discern the underlying cause(s) of performance fluctuations. Is the failure to discern the causative or contributing factors a failure of capability? Or imagination? Do the fluctuations have their genesis in some inscrutable aspect of the system or software? Does it warrant a fundamental reassessment and rethinking of how we assume and conceptualize performance reproducibility? Answers to these questions are
not straightforward, nor are they immediate or obvious. We conclude with a discussion about the performance of ensemble applications and ruminate over the implications for how we define and measure application performance.

Files (1.1 MB)
Name Size
ERROR 2022.pdf
md5:3e33fa18e6d96e2ad072d98764430c29
1.1 MB Download
29
24
views
downloads
All versions This version
Views 2929
Downloads 2424
Data volume 26.9 MB26.9 MB
Unique views 2626
Unique downloads 2222

Share

Cite as