Dataset Open Access

Dataset of Reducing the Effort for Systematic Reviews in Software Engineering

Francesco Osborne

Reducing the Effort for Systematic Reviews in Software Engineering

Background. Systematic Reviews (SRs) are means to collect and synthesize evidence from the identification, analysis and interpretation of multiple sources, or primary studies. To this aim, they use a well-defined methodology that should mitigate the risks of biases and ensure repeatability for later updates. SRs, however, involve significant effort.

Goal. The goal of this paper is to introduce a new methodology that, among other benefits, while taking advantage of the value provided by human expertise, reduces the amount of manual tedious tasks involved in SRs.

Method. Starting from current methodologies for SRs, we replaced the steps of keywording and data extraction with an automatic methodology for generating a domain ontology and classifying the primary studies. This methodology has been then applied in the software engineering sub-area of software architecture, and software quality, and evaluated with human annotators.

Results. The result is a novel expert-driven automatic methodology for performing SRs. This combines ontology-learning techniques and semantic technologies with the human-in-the-loop. The first (thanks to automation) fosters scalability, objectivity, reproducibility and granularity of the studies; the second allows tailoring to the specific focus of the study at hand, as well as knowledge reuse from domain experts.

Conclusions. Thanks to automation of the less creative steps in SRs, our methodology allows researchers to skip the tedious tasks of keywording and manually classifying primary studies, thus freeing effort for the analysis and the discussion.

Files (1.1 MB)
Name Size
EDAM_data.zip
md5:0c69ddfcc9184434582b75e47bdff860
441.5 kB Download
SE-ontology.owl
md5:5c3ee7cab4290b3a1e7da0348e28c97e
684.7 kB Download
70
12
views
downloads
All versions This version
Views 7070
Downloads 1212
Data volume 6.5 MB6.5 MB
Unique views 6262
Unique downloads 77

Share

Cite as