Report Open Access

A Survey of Field-based Testing Techniques

Antonia Bertolino; Pietro Braione; Guglielmo De Angelis; Luca Gazzola; Fitsum Kifetew; Leonardo Mariani; Matteo Orrù; Mauro Pezzè; Roberto Pietrantuono; Stefano Russo; Paolo Tonella

Field testing refers to testing techniques that operate in the field to reveal those faults that escape in-house testing. Field testing techniques are becoming increasingly popular with the growing complexity of contemporary software systems. In this paper, we present the first systematic survey of field testing approaches over a body of 80 collected studies, and propose their categorization based on the environment and the system on which field testing is performed. We discuss four research questions addressing how software is tested in the field, what is tested in the field, which are the requirements, and how field tests are managed, and identify many challenging research directions.

Files (903.4 kB)
Name Size
903.4 kB Download
All versions This version
Views 2323
Downloads 8585
Data volume 76.8 MB76.8 MB
Unique views 2121
Unique downloads 7070


Cite as