Published May 2025 | Version 1.0

Performance Dataset for Hardware Model Checking on Btor2 Benchmarks (Technical Report, May 2025)

  • 1. ROR icon Ludwig-Maximilians-Universität München
  • 2. ROR icon National Taiwan University
  • 3. ROR icon University of Waterloo

Description

This technical report presents a performance evaluation of several hardware model-checking tools on a collection of benchmark tasks in the Btor2 format.
The resulting dataset is intended to support machine-learning research for hardware model checking, particularly in areas such as algorithm selection,
performance prediction, and automated tool configuration. It has been used, for example, in the development and evaluation of Btor2-Select, a machine-learning-based algorithm selection framework for hardware model checking. To construct the dataset, we benchmarked a diverse set of model-checking tools and algorithmic configurations. Each verification engine was evaluated on a common set of Btor2 tasks and the performance measurements, including CPU time, wall time, and memory usage, were collected. All data, including scripts and files required to reproduce the experiments, are publicly available at: https://gitlab.com/sosy-lab/research/data/perf-eval-hwmc/-/tree/1.0.

Files

2025-05.Perf_Dataset_HWMC_Btor2.15605218.pdf

Files (575.4 kB)

Name Size Download all
md5:1f6258ad9c1268f8c16dcfaaae0c9162
575.4 kB Preview Download

Additional details