A Systematic Literature Review of Machine Learning for Uncovering Software Faults and Failures

This data set contains the results of an extensive, systematic literature review on the use of machine learning (ML) for uncovering software faults and failures. Covering the period of 2019 to 2022, this literature review identifies 874 relevant publications, classified into six distinct quality assurance tasks. Results show a compound annual growth rate (CAGR) of relevant publications of 38% over the last five years.

This literature review particularly analyzed in how far these relevant papers leverage synergies between different quality assurance tasks. Results show that only 3% of all relevant papers leverage such synergies, indicating ample opportunities for future research. For example, a single type of quality assurance activity may not suffice to deliver the expected software quality. Ideally, one would use a suitable combination of different types of activities – such as combining dynamic testing with static code analysis. Also, leveraging the synergies between different quality assurance activities can increase the effectiveness of the individual activities. For example, having a good estimate of the fault density of a software component (e.g., using deep learning-driven fault prediction techniques) could help optimize and prioritize testing effort and budget.