Mining twitter feeds for software user requirements

1. Does the paper propose a new opinion mining approach?

Yes

2. Which opinion mining techniques are used (list all of them, clearly stating their name/reference)?

For classification: Naive Bayes, Support Vector Machines, sentiment detected by Sentistrength as a feature for classifier For summarization: Hybrid Term Frequency, Hybrid TF.IDF by Inouye and Kalita, SumBasic by Nenkova and Vanderwende

3. Which opinion mining approaches in the paper are publicly available? Write down their name and links. If no approach is publicly available, leave it blank or None.

Sentistrength

4. What is the main goal of the whole study?

to evaluate the performance of multiple data classification and summarization techniques in automatically detecting and summarizing technical user concerns raised in software-relevant tweets

5. What the researchers want to achieve by applying the technique(s) (e.g., calculate the sentiment polarity of app reviews)?

to classify twitters into bug reports, user requirements, and other tweets

6. Which dataset(s) the technique is applied on?

4,000 manually classified tweets sampled from the Twitter feeds of 10 different software systems

7. Is/Are the dataset(s) publicly available online? If yes, please indicate their name and links.

http://seel.cse.lsu.edu/data/re17.zip

8. Is the application context (dataset or application domain) different from that for which the technique was originally designed?

retrained

9. Is the performance (precision, recall, run-time, etc.) of the technique verified? If yes, how did they verify it and what are the results?

for classification: 10-fold evaluation with Recall, precision, and F-measure for summarization: the average term overlap between our experts’ selected lists of tweets (reference summaries) and the various automatically generated summaries

10. Does the paper replicate the results of previous work? If yes, leave a summary of the findings (confirm/partially confirms/contradicts).

No

11. What success metrics are used?

N/A

12. Write down any other comments/notes here.

-