# Benchmark Link

1. https://github.com/tuhh-softsec/vul4j

# How to use the benchmark

1. Follow the instructions in the README.md of the vul4j repository to setup the environment.
2. Please make sure you have correct JDK version installed and configured as stated in the README.md of the vul4j repository.
3. The data with ID in VUL4J benchmark we measurement is in `tested_vul4j_number.txt`.


To use their benchmark, please cite their paper:
```
@inproceedings{vul4j2022,
  title={Vul4J: A Dataset of Reproducible Java Vulnerabilities Geared Towards the Study of Program Repair Techniques},  
  author={Bui, Quang-Cuong and Scandariato, Riccardo and Ferreyra, Nicol{\'a}s E. D{\'\i}az},  
  booktitle={2022 IEEE/ACM 19th International Conference on Mining Software Repositories (MSR)},   
  year={2022},
  pages={464-468},
  doi={10.1145/3524842.3528482}
}
```