Published April 17, 2024 | Version v1

A SAT Benchmark Suite for LTL Specification Sketching

  • 1. ROR icon TU Dortmund University
  • 2. Research Center Trustworthy Data Science and Security
  • 3. Max Planck Institute for Software Systems Kaiserslautern/Saarbruecken

Description

LTL_Sketcher-SAT_Benchmark

This repository contains a set of formulas in Propositional Boolean Logic.
These formulas are generated during the execution of our LTLSketcher tool.
Given an LTL sketch (i.e., a partial LTL formula) and a sample (i.e., a set of program executions labeled desired and undesired), the tool solves the LTL sketching problem, i.e., complete the sketch to a specification consistent with the data. (feel freet to check out our paper for more information on this problem)
In essence, this is done by reducing the problem to a series of formulas in Propositional Boolean Logic and checking their satisfiability.

Naming convention:

This repository contains each formula both in the DIMACS and SMTLib format.
Each file follows the same naming convention:

type__sample-file__sketch__size__algorithm-configuration__satisifability

type: indicates whether the formula is stored in the DIMACS or SMTLib format
sample-file: refers to the sample (cf., here) used by the LTLSketcher tool
sketch: refers to the sketch (cf., See experimental evaluation of our paper) used by the LTLSketcher tool
size: refers to the size of the complete solution (i.e., the number of subformulas of the complete specification)
algorithm-configuration: our algorithm can be extended by two heuristics (BMC and suffix), this indicates which combination of heuristics was used (none, either one of the two, both)
satisfiability: indicates whether the formula is satisfiable or not

Files

DIMACS.zip

Files (3.3 GB)

Name Size
md5:e89b00136dbde85ecf573b730fc69c7a
2.1 GB Preview Download
md5:b50cadc88df9bfb063d485dece9b04d1
1.2 GB Preview Download

Additional details

Related works

Is derived from
Conference paper: 10.1007/978-3-031-45332-8_2 (DOI)

Funding

Deutsche Forschungsgemeinschaft
Temporal Logic Sketching: A Computer-aided Approach to Writing Formal Specifications 434592664
Deutsche Forschungsgemeinschaft
FOR 5359: KI-FOR: Deep Learning on Sparse Chemical Process Data 459419731

References

  • Lutz, S., Neider, D., Roy, R. (2023). Specification Sketching for Linear Temporal Logic. In: André, É., Sun, J. (eds) Automated Technology for Verification and Analysis. ATVA 2023. Lecture Notes in Computer Science, vol 14216. Springer, Cham. https://doi.org/10.1007/978-3-031-45332-8_2