Published November 19, 2024 | Version v1

Interactive and Tool-Agnostic ML-Driven Workflow for Automated HPC Performance Modeling

  • 1. ROR icon Johannes Gutenberg University Mainz

Description

This work presents an automated, reproducible, ML-based performance modeling workflow for HPC systems. The proposed workflow fully automates data generation, preprocessing, ML model training and validation. The protoype implementation is based on the JUBE workflow environment, through which a user-friendly interactive console is realized. The effectiveness of the automated workflow is demonstrated with a case study on I/O bandwidth modeling and prediction.

Files

2024-SC24-Poster-Abstract-final-JUBE-ML.pdf

Files (2.9 MB)

Name Size Download all
md5:871ee962627686d7625b8c9c83d7ea0f
1.7 MB Preview Download
md5:0b0cdcabdbf9aec17d754870d292df03
1.2 MB Preview Download

Additional details

Dates

Accepted
2024-09-10
Other
2024-11-19
Presented