Benchmarking data for studying order-related performance effects

This dataset includes over 2.2M performance measurements collected on the CloudLab testbed. Performance tests from CPU and memory benchmarks were run in fixed and random orders allowing comprehensive comparisons. The analysis and the outcomes are summarized in the paper "Avoiding the Ordering Trap in Systems Performance Measurement", which will become available online in the near future and will be presented at USENIX ATC'23.

--------------

Contributors:

• Dmitry Duplyakin (University of Utah)

• Nikhil Ramesh (University of Utah) 

• Carina Imburgia (University of Washington) 

• Hamza Fathallah Al Sheikh (University of Utah) 

• Semil Jain (University of Utah) 

• Prikshit Tekta (University of Utah) 

• Aleksander Maricq (University of Utah) 

• Gary Wong (University of Utah) 

• Robert Ricci (University of Utah)