The Online Conversation Threads Repository (Slashdot, Barrapunto, Wikipedia talk)
This repository contains datasets with online conversation threads collected and analyzed by different researchers. Currently, you can find datsets from different news aggregators (Slashdot, Barrapunto) and the English Wikipedia talk pages.
- Slashdot conversations (Aug 2005 - Aug 2006) Online conversations generated at Slashdot during a year. Posts and comments published between August 26th, 2005 and August 31th, 2006. For each discussion thread: sub-domains, title, topics and hierarchical relations between comments. For each comment: user, date, score and textual content. This dataset is different from the Slashdot Zoo social network (it is not a signed network of users) contained in the SNAP repository and represents the full version of the dataset used in the CAW 2.0 - Content Analysis for the WEB 2.0 workshop for the WWW 2009 conference that can be found in several repositories such as Konect Barrapunto conversations (Jan 2005 - Dec 2008)
- Online conversations generated at Barrapunto (Spanish clone of Slashdot) during three years. For each discussion thread: sub-domains, title, topics and hierarchical relations between comments. For each comment: user, date, score and textual content Wikipedia (2001 - Mar 2010)
- Data from articles discussions (talk) pages of the English Wikipedia as of March 2010. It contains comments on about 870,000 articles (i.e. all articles which had a corresponding talk page with at least one comment), in total about 9.4 million comments. The oldest comments date back to as early as 2001.
Contain: /slashdot slashdot_with_comments.tgz (518M): compressed file with raw xml tree-YY-MM.mat (128M): conversation threads in Matlab structures format Fields data : struct with fields ; post data id : string ; identifier of the post user : string ; writer of the news post date : double ; seconds topics : string ; main topics tree : struct with fields ; hierarchical structure of the thread data : comment data: id, parentid, score, user and date parent : index in tree(index) of the parent (-42 for the root node) depth : depth in the thread child : vector of children /barrapunto raw_xml.tgz (85M): compressed file with raw xml tree-YY.mat (22M): conversation threads in Matlab structures /wikipedia AllArticleTitles.csv.tar.gz (85M): compressed file with article titles all_comments.csv.tar.gz (1.6G): compressed file with comments WP_tree_raw_data_X.mat (87M): conversation threads in Matlab structures Software: Matlab
This work is supported by the Spanish Ministry of Economy and Competitiveness
under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and
co-financed by the Marie Curie FP7-PEOPLE-2012-COFUND Action. Grant agreement
D. Laniado, R. Tasso, Y. Volkovich, A. Kaltenbrunner (2011). When the Wikipedians Talk: Network and Tree Structure of Wikipedia Discussion Pages. Fifth International AAAI Conference on Weblogs and Social Media
V. Gómez, A. Kaltenbrunner, V. López (2008) Statistical analysis of the social network and discussion threads in Slashdot. Proceedings of the 17th International World Wide Web Conference
V. Gómez, H. J. Kappen, N. Litvak, A. Kaltenbrunner (2013). A likelihood-based framework for the analysis of discussion threads. World Wide Web 16(5-6):645-675