10.1007/s11219-017-9388-0
https://zenodo.org/records/1006705
oai:zenodo.org:1006705
Breno Miranda
Breno Miranda
0000-0001-9608-9393
Federal University of Pernambuco
Antonia Bertolino
Antonia Bertolino
0000-0001-8749-1356
ISTI - CNR
An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testing
Zenodo
2017
Coverage testing
Operational coverage
Operational profile-based testing
Program Spectra
Relative coverage
2017-09-22
eng
10.13039/100010661
https://zenodo.org/communities/elastest
https://zenodo.org/communities/eu
Creative Commons Attribution 4.0 International
While the relation between code coverage measures and fault detection is actively studied, only few works have investigated the correlation between measures of coverage and of reliability. In this work, we introduce a novel approach to measuring code coverage, called the operational coverage, that takes into account how much the program's entities are exercised so to reflect the profile of usage into the measure of coverage. Operational coverage is proposed as (i) an adequacy criterion, i.e., to assess the thoroughness of a black box test suite derived from the operational profile, and as (ii) a selection criterion, i.e., to select test cases for operational profile-based testing. Our empirical evaluation showed that operational coverage is better correlated than traditional coverage with the probability that the next test case derived according to the user's profile will not fail. This result suggests that our approach could provide a good stopping rule for operational profile-based testing. With respect to test case selection, our investigations revealed that operational coverage outperformed the traditional one in terms of test suite size and fault detection capability when we look at the average results.
European Commission
10.13039/501100000780
731535
ElasTest: an elastic platform for testing complex distributed large software systems