Bootstrapped Lexicon of English Polarity Shifters

We provide a bootstrapped lexicon of English polarity shifters and their shifting direction. We cover verbs, nouns and adjectives. Our lexicon provides 2521 shifters among a vocabulary of 9145 words, taken from WordNet v3.1 (Miller et al., 1990).

We also provide a dataset of 2631 verb phrases that are annotated for shifting polarities. The phrases are taken from the Amazon Product Review Data corpus (Jindal & Liu, 2008).

Data

1. Polarity Shifter Lexicon

A list of 9145 words, annotated for whether they are polarity shifters. Contains 2631 shifters and 6514 non-shifters.

• File: shifters.txt
• The lexicon is a comma-separated value (CSV) table
• Each line follows the format POS,LEMMA,SHIFTER_LABEL,SOURCE.
  • POS: The part of speech of the word (verb, noun, adj)
  • LEMMA: The lemma representation of the word in question. Multiword expressions are separated by an underscore (WORD_WORD).
  • SHIFTER_LABEL: Whether the word is a polarity shifter (SHIFTER) or a non-shifter (NONSHIFTER)
  • SOURCE: Whether the word was part of the gold standard (GOLD_STANDARD) or was bootstrapped (BOOTSTRAPPED). All labels, both from gold standard and bootstrap output, were verified by a human annotator.

2. Sentiment Verb Phrases

A set of verb phrases, annotated for the polarity of the verb phrase and the polarity of a polar noun that it contains. Can be used to evaluate whether a polarity classifier correctly recognizes polarity shifting. The file starts with 400 phrases containing shifter verbs, followed by 2231 phrases containing non-shifter verbs.

• File: sentiment_phrases.txt
• Every item consists of:
  • The sentence from which the VP and the polar noun were extracted.
  • The VP, polar noun and the verb heading the VP.
  • Constituency parse for the VP.
  • Gold labels for VP and polar noun by a human annotator.
  • Predicted labels for VP and polar noun by RNTN tagger (Socher et al., 2013) and LEX_gold approach.
  • Items are separated by a line of asterisks (*)

Attribution
This dataset was created as part of the following publication:

Schulder, Marc and Wiegand, Michael and Ruppenhofer, Josef (2020). "Automatic Generation of Lexica for Sentiment Polarity Shifters". In: Natural Language Engineering. doi:10.1017/S135132492000039X

If you use the data in your research or work, please cite the publication.