Published June 15, 2022 | Version 1.1
Software Open

balfroim/MuTEd: 1.1

  • 1. UNamur

Contributors

  • 1. UNamur

Description

MuTEd, which stands for Mutation Testing Education, is the code name for our master thesis. We conducted a comparative study of two reporting tools for teaching software testing to undergraduates. One, PIT, applies classical mutation testing and the other, Reneri, uses extreme mutation testing.

Abstract

Although software testing is critical in software engineering, studies have shown a significant gap between students' knowledge of software testing and the industry's needs, hinting at the need to explore novel approaches to teach software testing. Among them, classical mutation testing has already proven to be effective in helping students. We hypothesise that extreme mutation testing could be more effective by introducing more obvious mutants to kill. In order to study this question, we organised an experiment with two undergraduate classes comparing the usage of two tools, one applying classical mutation testing, and the other one applying extreme mutation testing. The results contradicted our hypothesis. Indeed, students with access to the classic mutation testing tool obtained a better mutation score, while the others seem to have mostly covered more code. Finally, we have published and anonymised the students' test suites in adherence to best open-science practices, and we have developed guidance based on previous evaluations and our own results.

Files

balfroim/MuTEd-1.1.zip

Files (811.9 kB)

Name Size Download all
md5:27624e413f8b20578d07f8041fc6c6dc
811.9 kB Preview Download

Additional details

Related works