Feedback Generation for Automatic User Interface Design Evaluation: Relevant Literature

We performed an SLR to determine relevant works in the field of automatic usability UI evaluation, following the guidelines proposed by Kitchenham and Charters. The main research questions that need to be answered are:

• RQ1: Which general techniques are used in the automatic usability evaluation?
• RQ2: Which usability techniques are used in the automatic evaluation?
• RQ3: What automation level is achieved by the researchers?
• RQ4: What kind of UI are evaluated?

We performed our search on the Scopus database, one of the largest databases of the peer reviewed literature covering all important publishers such as ACM, IEEE, Springer, Elsevier and many more. We identified key words from the research questions. A traditional search was performed that allowed determining the most appropriate search terms. The terms were validated by two experts in the field. The final search string used was: TITLE-ABS-KEY (( automatic)  AND  usability  AND  (evaluation  OR  study  OR  experiment))  AND  (LIMIT-TO (SUBJAREA,  "COMP")  OR  LIMIT-TO (SUBJAREA,  "ENGI")). To assess the quality of the query, we checked that the studies we already knew to be relevant (such as [13], [14]) appeared in the results.

The query resulted in a collection of 418 papers dating from 2009 to 2019 of which 45 papers were retained. The table presents these 45 papers and their classification along the Research Questions.

The full paper is published under the following title:

Feedback Generation for Automatic User Interface Design Evaluation
Jenny Ruiz^{1[0000-0002-1371-6353]} and Monique Snoeck^{2[0000-0002-3824-3214]
1} University of Holguin, Holguin 80100, Cuba, jruizp@uho.edu.cu
² KU Leuven, Leuven, 3000, Belgium, monique.snoeck@kuleuven.be

CCIS Series published by Springer