Artifact of SearchGEM5: Towards Reliable gem5 with Search Based Software Testing and Large Language Models

This is the official artifact of the paper: SearchGEM5: Towards Reliable gem5with Search Based Software Testing and Large Language Models with the SearchGem5 tool available at GitHub: https://github.com/karineek/SearchGem5.

This artifact contains:

• Gem5Testing-main.zip: is a snapshot of our GitHub repository. We will make the GitHub open access after de-anonymising the work (after the review phase).
  • NOTE: NOT ALL FOLDERS MARKED AS "BUG" ARE REAL BUGS. We investigated each of them semi-manually and mapped the real bugs in the Excel file: SSBSE-gem5-bugs.xlsx.
• LLM-test-case-pattern-generation-prompts.zip: examples of the prompts used in our work.
• SSBSE-gem5-bugs.xlsx: details and summary of our bugs and their classification (with paths in Gem5Testing-main.zip where the data per bug is). This file is the actual results we reported in the paper.
• Last the coverage data and instrumented with gcov binaries used in the evaluation: AFTER-AFL-COV.zip, BEFORE-AFL-COV.zip, and gem5-instrumented-with-coverage-x86-ubuntu-20.04-gcc-9.zip.

Data Availability: The files contain data and all our source code as part of the Open Science Policy.

Citation

Aidan Dakhama, Karine Even-Mendoza, W.B. Langdon, Hector Menendez, and Justyna Petke (2023). SearchGEM5: Towards Reliable gem5 with Search Based Software Testing and Large Language Models. Symposium on Search Based Software Engineering (SSBSE).

BibTex entry:

@inproceedings{EvenMendoza2023Gem5,
  title={SearchGEM5: Towards Reliable gem5 with Search Based Software Testing and Large Language Models},
  author={Aidan Dakhama, Karine Even-Mendoza, W.B. Langdon, Hector Menendez, and Justyna Petke},
  booktitle={Lecture Notes in Computer Science}
  year={2023},
  publisher={15th Symposium on Search Based Software Engineering (SSBSE)}
}