Dataset Open Access

Test Smell Detection Tools: A Systematic Mapping Study

Aljedaani, Wajdi; Peruma, Anthony; Aljohani, Ahmed; Alotaibi, Mazen; Mkaouer, Mohamed Wiem; Ouni, Ali; Newman, Christian D.; Ghallab, Abdullatif; Ludi, Stephanie

This is the dataset that accompanies the study: "Test Smell Detection Tools: A Systematic Mapping Study." This study has been accepted for publication at 2021 The International Conference on Evaluation and Assessment in Software Engineering (EASE '21).

 

Following is the abstract of the study:

Test smells are defined as sub-optimal design choices developers make when implementing test cases. Hence, similar to code smells, the research community has produced numerous test smell detection tools to investigate the impact of test smells on the quality and maintenance of test suites. However, little is known about the characteristics, type of smells, target language, and availability of these published tools. In this paper, we provide a detailed catalog of all known, peer-reviewed, test smell detection tools.

We start with performing a comprehensive search of peer-reviewed scientific publications to construct a catalog of 22 tools. Then, we perform a comparative analysis to identify the smell types detected by each tool and other salient features that include programming language, testing framework support, detection strategy, and adoption, among others. From our findings, we discover tools that detect test smells in Java, Scala, Smalltalk, and C++ test suites, with Java support favored by most tools. These tools are available as command-line and IDE plugins, among others. Our analysis also shows that most tools overlap in detecting specific smell types, such as General Fixture. Further, we encounter four types of techniques these tools utilize to detect smells. We envision our study as a one-stop source for researchers and practitioners in determining the tool appropriate for their needs. Our findings also empower the community with information to guide future tool development.

For more information about our research on test smells, visit: https://testsmells.org/
Files (308.8 kB)
Name Size
EASE2021-Dataset_FilteringProcess.xlsx
md5:7979c4185a00f08bd907a4d8f15e0dab
60.7 kB Download
EASE2021-Dataset_Tools.xlsx
md5:eb76170ec77ad3e28b50c46c407a3c95
23.1 kB Download
EASE2021-Figure01.pdf
md5:03c182ee3531651188ca9f298897895f
106.0 kB Download
EASE2021-Figure03.pdf
md5:68a64847e2d282f0eb769a1af1e43595
118.1 kB Download
EASE2021-ReadMe.txt
md5:39dc1b677980b3c2ef49dc0d57fdd294
814 Bytes Download
138
150
views
downloads
All versions This version
Views 138138
Downloads 150150
Data volume 13.8 MB13.8 MB
Unique views 122122
Unique downloads 101101

Share

Cite as