Decov

Artifacts for the ESEC/FSE 2023 submission #1032

We sincerely apologize for the delay in uploading the full artifacts.

Rest assured, we are diligently working to finalize our preparations and will make the upload available at the earliest opportunity.

Thank you for your patience and understanding.

Decov: Heterogeneous Testing Coverage Profilers

C2V: Hunting for bugs in code coverage tools via randomized differential testing

Cod: Automatic Self-Validation for Code Coverage Profilers

Table of Contents

• Background
• Install
• Usage
• Experiment
• Data

Background

We run Decov, C2V, and Cod for Gcov and LLVM-cov along with Gcc and LLVM over the test programs in the Gcc-7.4.0 testsuites.

Install

This project uses gcc, gdb, llvm and lldb. Go check them out if you don't have them locally installed.

apt install python3 gcc llvm clang gdb lldb

Usage

First, unzip gcc-7.4.0:

tar -xvf gcc-7.4.0.tar.xz 

Then, run Decov, C2V, and Cod over the testsuite of gcc-7.4.0 in parallel:

python3 main.py --parallel -s gcc-7.4.0/gcc/testsuite/

Note that, we can also run our tool without parallel enabled if your computer does not have multi-cores:

python3 main.py -s gcc-7.4.0/gcc/testsuite/ 

Data

After the Execution, the Experimental data are in the Expr folder:

• C2V/files-DIFFCOV-C2V.txt: the filenames when the coverage statistics is inconsistent for Gcov and LLVM-cov
• C2V/files-SAMECOV-C2V.txt: the filenames when the coverage statistics is consistent for for Gcov and LLVM-cov
• Cod/files-DIFFCOV-gcov-Cod.txt and Cod/files-DIFFOUT-gcov-Cod.txt: the filenames when the coverage statistics and the output of the original program and the equivalent mutant violate the metamorphic relations for Gcov
• Cod/files-DIFFCOV-lcov-Cod.txt and Cod/files-DIFFOUT-lcov-Cod.txt: the filenames when the coverage statistics and the output of the original program and the equivalent mutant violate the metamorphic relations for LLVM-cov
• Cod/files-SAMECOV-gcov-Cod.txt and Cod/files-SAMECOV-lcov-Cod.txt: the filenames when the coverage statistics of the original and the equivalent mutant consistent with the metamorphic relations for Gcov and LLVM-cov
• DeCov/files-DIFFCOV-gcov-DeCov.txt and DeCov/files-SAMECOV-gcov-DeCov.txt: the filenames when the coverage statistics from Gcov and the hit count from GDB is inconsistent and consistent, respectively
• DeCov/files-DIFFCOV-lcov-DeCov.txt and DeCov/files-SAMECOV-lcov-DeCov.txt: the filenames when the coverage statistics from LLVM and the hit count from LLDB is inconsistent and consistent, respectively