Verification Witnesses from Verification Tools (SV-COMP 2023)

SV-COMP 2023

Verification Witnesses

This file describes the contents of an archive of the 12th Competition on Software Verification (SV-COMP 2023). https://sv-comp.sosy-lab.org/2023/

The competition was organized by Dirk Beyer, LMU Munich, Germany. More information is available in the following article: Dirk Beyer. Competition on Software Verification and Witness Validation: SV-COMP 2023. In Proceedings of the 29th International Conference on Tools and Algorithms for the Construction and Analysis of Systems (TACAS 2023, Munich, April 22 - 27), 2023. Springer.

Copyright (C) Dirk Beyer https://www.sosy-lab.org/people/beyer/

SPDX-License-Identifier: CC-BY-4.0 https://spdx.org/licenses/CC-BY-4.0.html

Contents

• LICENSE.txt: specifies the license
• README.txt: this file
• witnessFileByHash/: This directory contains verification witnesses. Each verification witness in this directory is stored in a file whose name is the SHA2 256-bit hash of its contents followed by the filename extension .graphml. The format of each verification witness is described on the format web page: https://github.com/sosy-lab/sv-witnesses/ A verification witness contains also metadata in order to relate it to the verification task for which it was produced.
• witnessInfoByHash/: This directory contains for each verification witness in directory witnessFileByHash/ a record in JSON format (also using the SHA2 256-bit hash of the witness as filename, with .json as filename extension) that contains the meta data.
• witnessListByProgramHashJSON/: For convenient access to all verification witnesses for a certain program, this directory represents a function that maps each program (via its SHA2256-bit hash) to a set of verification witnesses (JSON records for verification witnesses as described above) that the verification tools have produced for that program. For each program for which verification witnesses exist, the directory contains a JSON file (using the SHA2 256-bit hash of the program as filename, with .json as filename extension) that contains all JSON records for verification witnesses for that program.

The data structure is described in the following article: Dirk Beyer. A Data Set of Program Invariants and Error Paths. In Proceedings of the 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR 2019, Montreal, Canada, May 26-27), pages 111-115, 2019. IEEE. https://doi.org/10.1109/MSR.2019.00026

Other Archives

Overview over archives from SV-COMP 2023 that are available at Zenodo:

• https://doi.org/10.5281/zenodo.7627791 Verification Witnesses from SV-COMP 2023 Verification Tools. Witness store (containing the generated verification witnesses)
• https://doi.org/10.5281/zenodo.7627829 Tool Archives from SV-COMP 2023. Executable tools that were evaluated in the competition
• https://doi.org/10.5281/zenodo.7627787 Results of the 12th Intl. Competition on Software Verification (SV-COMP 2023). Results (XML result files, log files, file mappings, HTML tables)
• https://doi.org/10.5281/zenodo.7627783 SV-Benchmarks: Benchmark Set of SV-COMP 2023 and Test-Comp 2023. Verification tasks, version svcomp23
• https://doi.org/10.5281/zenodo.7612021 BenchExec, version 3.16. Benchmarking framework

All benchmarks were executed for SV-COMP 2023 https://sv-comp.sosy-lab.org/2023/ by Dirk Beyer, LMU Munich, based on the following components:

• https://gitlab.com/sosy-lab/sv-comp/archives-2023 svcomp23 ca51c0c69ed4d4f6fd867c10abbc9b000d8ffb03
• https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks svcomp23 f87854c275a177e8dc3673fe6959cd89038652af
• https://gitlab.com/sosy-lab/sv-comp/bench-defs svcomp23 d34d04f1332a49c219293798b90eee6b3760946d
• https://gitlab.com/sosy-lab/software/benchexec 3.16 b43e7384112770a41b571399135065daa7f387ab
• https://gitlab.com/sosy-lab/benchmarking/competition-scripts svcomp23 e6f84b5a79626b4295108a0f96ea370edde1f023
• https://github.com/sosy-lab/sv-witnesses svcomp23 e16b1fdddfa7770918c2d06bdcd0103e88e32691
• https://gitlab.com/sosy-lab/software/coveriteam svcomp23 76a8e4dba327af4606e2a30544656b7882f75848

Contact

Feel free to contact me in case of questions: https://www.sosy-lab.org/people/beyer/