The impact of cross-platform development approaches for mobile applications from the user's perspective

1. Does the paper propose a new opinion mining approach?

Yes

2. Which opinion mining techniques are used (list all of them, clearly stating their name/reference)?

The authors of this study do not explicitly classify sentiment/opinion of app reviews. They rather implement an approach for selecting reviews that contain complaints. We used a na¨ıve keyword-based Natural Language Processing (NLP) technique available in PostgreSQL to build a model that can classify reviews as complaints in one of the four quality concerns, namely performance, usability, security, and reliability.

3. Which opinion mining approaches in the paper are publicly available? Write down their name and links. If no approach is publicly available, leave it blank or None.

no

4. What is the main goal of the whole study?

Classification of reviews based on the quality concern dimensions, among performance, usability, security, reliability.

5. What the researchers want to achieve by applying the technique(s) (e.g., calculate the sentiment polarity of app reviews)?

see answer above

6. Which dataset(s) the technique is applied on?

787,228 reviews in total (319,279 from the Play Store and 467,949 from the App Store)

7. Is/Are the dataset(s) publicly available online? If yes, please indicate their name and links.

no, they only share the app list: https://gist.github.com/ivantm24/88ff33a6cb20909309a73f951096390f

8. Is the application context (dataset or application domain) different from that for which the technique was originally designed?

no

9. Is the performance (precision, recall, run-time, etc.) of the technique verified? If yes, how did they verify it and what are the results?

The filtering approach for identifications of the complaint is not evaluated. The evaluation is performed only for the classifier aimed at addressing the main goal of the study, i.e. being able to

10. Does the paper replicate the results of previous work? If yes, leave a summary of the findings (confirm/partially confirms/contradicts).

no

11. What success metrics are used?

NA

12. Write down any other comments/notes here.

The paper does not mention sentiment analysis nor opinion mining. However, this is kind of related to opinion mining as the authors implement an ad hoc approach for filtering out all the reviews that do not express a complaint. I am not sure we need to include this, though.