Webis ChangeMyView Corpus 2020 (Webis-CMV-20)

The Webis-CMV-20 dataset comprises all available posts and comments in the ChangeMyView subreddit from the foundation of the subreddit in 2005, until September 2017. From these, we have derived two sub-datasets for the tasks of persuasiveness prediction, and opinion malleability prediction. In addition, the corpus comprises historical posts by CMV authors, and derived personal characteristics.

Dataset specification

All files are in bzip2-compressed JSON Lines format.

• threads.jsonl: contains all the selected discussion threads from CMV
• pairs.jsonl: each record contains submission, delta-comment and nondelta-comment and the comments' similarity score
• posts-malleability.jsonl: contains posts for opinion mallebility prediction, in the format provided in the original Reddit Crawl dataset
• author_entity_category.jsonl: each record contains the author and list of Wikipedia entities mentioned by the author in the messages across all subreddits. For each mentioned entity we provide the following data: 

[title, wikidata_id, wikipedia_page_id, mentioned_entity_title, wikifier_score, subreddit_name, subreddit_id, subreddit_category_name, subreddit_topcategory_name]

• author_liwc.jsonl: personality traits features computed with LIWC for the authors from pairs.jsonl and post_malleability.jsonl datasets
• author_subreddit.jsonl: for each author statistics of all number of all posts (submissions/comments) across all subreddits are provided
• author_subreddit_category.jsonl: similar to author_subreddit.jsonl, the statistics of all author posts is grouped by top-categories and categories according to snoopsnoo.com