Published September 13, 2024 | Version v1
Dataset Open

Supplemental material for: Software System Testing assisted by Large Language Models: An Exploratory Study

Description

This is the supplemental material of the paper titled as “Software System Testing Assisted by Large Language Models: An Exploratory Study” presented at the 36th International Conference on Testing Software and Systems.

It contains the raw execution data generated by both models, GPT-4o and GPT-4omini, during the exploratory study. The supplementary material includes the following files:

  • GPT-4ominiRQ1-2ExecutionData.zip: contains the JSON outputs from the OpenAI API for the GPT-4o mini model. Each output is labeled according to the research question number and the corresponding timestamp (for RQ1) or the requested test case (for RQ2), all provided in plain text format.
  • GPT-4oRQ1-2ExecutionData.zip: contains the JSON outputs from the OpenAI API for the GPT-4o model. Like the previous file, each output is named in plain text format based on the research question number and timestamp (for RQ1) or the requested test case (for RQ2).

To cite this work: 

C. Augusto, J. Morán, A. Bertolino, C. de la Riva and J. Tuya, “Software System Testing assisted by Large Language Models: An Exploratory Study”, in 36th International Conference on Testing Software and Systems, London (England), XXXX, November 2024, doi: XXXXX

Notes

This work was supported in part by the project PID2022-137646OB-C32 under Grant MCIN/ AEI/10.13039/501100011033/FEDER, UE, and in part by the project MASE RDS-PTR_22_24_P2.1 Cybersecurity (Italy).

Files

GPT-4ominiRQ1-2ExecutionData.zip

Files (79.9 kB)

Name Size Download all
md5:8f9ad833c7988d2215fc2b3cc4f660fe
39.3 kB Preview Download
md5:321bbcfa30a31c46ab2b0e94f504cee0
40.6 kB Preview Download

Additional details

Funding

MCIN/ AEI/10.13039/501100011033/FEDER PID2022-137646OB-C32
Ministerio de Ciencia e Innovación
(CyberSecurity) RDS-PTR_22_24_P2.1
Institute of Information Science and Technologies

Software

Repository URL
https://github.com/giis-uniovi/retorch-llm-rp
Programming language
Java
Development Status
Concept