ARCH-COMP 2022 Category Report: Falsification with Ubounded Resources

This report presents the results from the 2022 friendly competition in the ARCH workshop for the falsification of temporal logic specifications over Cyber-Physical Systems. We briefly describe the competition settings, which have been inherited and adapted from the previous years, give background on the participating teams and tools, and discuss the selected benchmarks. In this year’s competition, in addition to the result validation introduced in the previous year, we change the experimental settings for a better account of the difficulty of benchmarks and for a better comparability between the tools.

There are three files. The data submitted by the participants is stored in the results archive. The validator infrastructure is stored in validation and the produced validation report is stored in report.

To re-run the validation on Linux with a somewhat recent MATLAB installation, unpack the first two archives in the same directory. Make sure that the models folder from https://gitlab.com/goranf/ARCH-COMP is available at relative path ../../models/ which you can check by:

ls ../../models
ls validation/falstar.sh

To run validation, proceed as follows

cd validation
./falstar-config.sh # once
./falstar.sh validate-$TOOL.cfg

where $TOOL is the name of one of the tools such that the corresponding configuration file exists.

If there are open issues, please contact Gidon Ernst <gidon.ernst@lmu.de>