A benchmark for NuSMV extensions to BeepBeep 3

This lab studies a formalization of event stream processing pipelines as Kripke structures that can be handled by a model checker. More specifically, the BeepBeep event stream processing library has been modified in order to export chains of processors as input files for the NuSMV model checking tool. This makes it possible to formally verify properties on these pipelines, and opens the way to the use of such pipelines directly within a model checker as an extension of its specification language.

The goal of this benchmark is to perform an experimental evaluation of the proposed implementation, by measuring the execution time and memory consumption of NuXmv on a number of BeepBeep pipelines and for a sample of generic properties, with a special focus on the impact of parameters Q (the size of the internal queues in each processor) and N (the size of the domain for numerical variables).

This repository contains an instance of LabPal, an environment for running experiments on a computer and collecting their results in a user-friendly way. The author of this archive has set up a set of experiments, which typically involve running scripts on input data, processing their results and displaying them in tables and plots. LabPal is a library that wraps around these experiments and displays them in an easy-to-use web interface. The principle behind LabPal is that all the necessary code, libraries and input data should be bundled within a single self-contained JAR file, such that anyone can download and easily reproduce someone else's experiments. Detailed instructions can be found on the LabPal website, [https://liflab.github.io/labpal].

The bundled JAR file in this artifact contains all the source code, documentation, and compiled Java files to run, display and modify the set of experiments mentioned in the related publication.