Verification Witnesses from Verification Tools (SV-COMP 2026)
Authors/Creators
Description
SV-COMP 2026
Verification Witnesses
This file describes the contents of an archive of the 15th Competition on Software Verification (SV-COMP 2026). https://sv-comp.sosy-lab.org/2026/
The competition was organized by Dirk Beyer, LMU Munich, Germany and Jan Strejček, Masaryk University, Czechia.More information is available in the following article: Dirk Beyer and Jan Strejček. Evaluating Software Verifiers for C, Java, and SV-LIB (Report on SV-COMP 2026). In Proceedings of the 32nd International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2026, Turin, Italy, April 11–16), 2026. Springer.
Copyright (C) 2026 Dirk Beyer and Jan Strejček
SPDX-License-Identifier: CC-BY-4.0 https://spdx.org/licenses/CC-BY-4.0
Contents
LICENSE.txt: specifies the licenseREADME.txt: this filefileByHash/: This directory contains verification witnesses. Each verification witness in this directory is stored in a file whose name is the SHA2 256-bit hash of its contents followed by the filename extension .graphml or .yml. The format of the verification witnesses is described on the format web page: https://gitlab.com/sosy-lab/benchmarking/sv-witnesses A verification witness contains also metadata in order to relate it to the verification task for which it was produced.witnessInfoByHash/: This directory contains for each verification witness in directory witnessFileByHash/ a record in JSON format (also using the SHA2 256-bit hash of the witness as filename, with .json as filename extension) that contains the meta data.witnessListByProgramHashJSON/: For convenient access to all verification witnesses for a certain program, this directory represents a function that maps each program (via its SHA2256-bit hash) to a set of verification witnesses (JSON records for verification witnesses as described above) that the verification tools have produced for that program. For each program for which verification witnesses exist, the directory contains a JSON file (using the SHA2 256-bit hash of the program as filename, with .json as filename extension) that contains all JSON records for verification witnesses for that program.
The data structure is described in the following article: Dirk Beyer. A Data Set of Program Invariants and Error Paths. In Proceedings of the 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR 2019, Montreal, Canada, May 26-27), pages 111-115, 2019. IEEE. https://doi.org/10.1109/MSR.2019.00026
Related Archives
Overview of archives from SV-COMP 2026 that are available at Zenodo:
- https://doi.org/10.5281/zenodo.18651735 Verification Witnesses from Verification Tools (SV-COMP 2026). Witness store (containing the generated verification witnesses)
- https://doi.org/10.5281/zenodo.18650756 FM-Tools Release 2.3: Data Set of Metadata about Tools for Formal Methods (SV-COMP 2026, Test-Comp 2026). Metadata snapshot of the evaluated tools (DOIs, options, etc.)
- https://doi.org/10.5281/zenodo.18651757 Results of the 15th Intl. Competition on Software Verification (SV-COMP 2026). Results (XML result files, log files, file mappings, HTML tables)
- https://doi.org/10.5281/zenodo.18650775 SV-Benchmarks: Benchmark Set for Software Verification and Testing (SV-COMP 2026, Test-Comp 2026). Verification tasks, version svcomp26
- https://doi.org/10.5281/zenodo.18455156 sosy-lab/benchexec: Release 3.34 Benchmarking framework
- https://doi.org/10.5281/zenodo.18650812 FM-Weck: Release 1.6.0 Containerized execution and continuous testing of formal-methods tools
All benchmarks were executed for SV-COMP 2026 https://sv-comp.sosy-lab.org/2026/ by Dirk Beyer, LMU Munich, based on the following components:
- https://gitlab.com/sosy-lab/benchmarking/fm-tools 2.3
- https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks svcomp26
- https://gitlab.com/sosy-lab/sv-comp/bench-defs svcomp26
- https://gitlab.com/sosy-lab/software/benchexec 3.34
- https://gitlab.com/sosy-lab/software/benchcloud 1.5.0
- https://gitlab.com/sosy-lab/software/fm-weck 1.6.0
- https://gitlab.com/sosy-lab/benchmarking/sv-witnesses 2.1.2
- https://gitlab.com/sosy-lab/benchmarking/competition-scripts svcomp26
Contact
Feel free to contact me in case of questions: https://www.sosy-lab.org/people/beyer/
Files
svcomp26-witnesses.zip
Files
(15.8 GB)
| Name | Size | Download all |
|---|---|---|
|
md5:06f3a1cb33a089272185bdd680322007
|
15.8 GB | Preview Download |