High-performance computing input/output variability
Authors/Creators
Description
Cameron et al. (2019) investigated the input/output (IO) performance variability of high-performance computing (HPC) systems under different system configurations, using the IOzone benchmark (Norcott, 2019) to measure IO performance across a range of settings. The response variable in the HPC dataset is the IO throughput variability, while the predictors include both continuous and categorical variables. We use a subset of the dataset from Cameron et al. (2019), which includes two continuous variables, CPU frequency and number of threads, and one categorical variable, the IO operation mode. The CPU frequency has 15 distinct values, and the number of threads has nine. The IO operation mode has 13 levels: Initial write, Fwrite, Random write, Pwrite, Rewrite, Randomread, Mixed workload, Stride read, Reverse read, Re-read, Fread, Pread, and Read. This dataset has also been used for statistical modeling and analysis in Zhang et al. (2021) and Xu et al. (2021).
Files
sub_iozone.csv
Files
(48.5 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:e171fd363de206499eb16c962062fe08
|
48.5 kB | Preview Download |
Additional details
Dates
- Submitted
-
2025-10-20
References
- Xu, L., Lux, T., Chang, T., Li, B., Hong, Y., Watson, L, Butt, A., Yao, D., and Cameron, K. (2021), Prediction of high-performance computing input/output variability and its application to optimization for system configurations. Quality Engineering, 33(2), 318-334.
- Zhang, Q., Chien, P., Liu, Q., Xu, L., and Hong, Y. (2021), Mixed-input Gaussian process emulators for computer experiments with a large number of categorical levels. Journal of Quality Technology, 53(4), 410-420.
- Cameron, K. W., Anwar, A., Cheng, Y., Xu, L., Li, B., Ananth, U., Bernard, J., Jearls, C., Lux, T., Hong, Y., Watson, L. T., and Butt, A. R. (2019). MOANA: Modeling and analyzing I/O variability in parallel system experimental design. IEEE Transactions on Parallel and Distributed Systems, 30(8), 1843-1856.
- Norcott, W. D. (2019). IOzone Filesystem Benchmark. Available at http://www.iozone.org/.