A Systematic Review on Cloud Testing

A systematic literature review is presented that surveyed the topic of cloud testing over the period 2012–2017.
Cloud testing can refer either to testing cloud-based systems (testing of the cloud) or to leveraging the cloud
for testing purposes (testing in the cloud): both approaches (and their combination into testing of the cloud in
the cloud) have drawn research interest. An extensive paper search was conducted by both automated query
of popular digital libraries and snowballing, which resulted in the final selection of 147 primary studies.
Along the survey, a framework has been incrementally derived that classifies cloud testing research among
six main areas and their topics. The article includes a detailed analysis of the selected primary studies to
identify trends and gaps, as well as an extensive report of the state-of-the-art as it emerges by answering the
identified Research Questions. We find that cloud testing is an active research field, although not all topics
have received enough attention and conclude by presenting the most relevant open research challenges for
each area of the classification framework.