Journal article Open Access

An assessment of operational coverage as both an adequacy and a selection criterion for operational profile based testing

Breno Miranda; Antonia Bertolino

While the relation between code coverage measures and fault detection is actively studied, only few works have investigated the correlation between measures of coverage and of reliability. In this work, we introduce a novel approach to measuring code coverage, called the operational coverage, that takes into account how much the program's entities are exercised so to reflect the profile of usage into the measure of coverage. Operational coverage is proposed as (i) an adequacy criterion, i.e., to assess the thoroughness of a black box test suite derived from the operational profile, and as (ii) a selection criterion, i.e., to select test cases for operational profile-based testing. Our empirical evaluation showed that operational coverage is better correlated than traditional coverage with the probability that the next test case derived according to the user's profile will not fail. This result suggests that our approach could provide a good stopping rule for operational profile-based testing. With respect to test case selection, our investigations revealed that operational coverage outperformed the traditional one in terms of test suite size and fault detection capability when we look at the average results.

Files (11.7 MB)
Name Size
MirandaBertolino-SQJ.pdf
md5:74d432ec0cd96b3b51705e1214d1641a
1.2 MB Download
raw_experimental_data.zip
md5:24f0f0954b627408182d4dedf320e9c7
10.6 MB Download
11
22
views
downloads
Views 11
Downloads 22
Data volume 34.8 MB
Unique views 11
Unique downloads 20

Share

Cite as