Department of Information and Communication Technologies, UPF, Barcelona
Published April 25, 2008 | Version v1
Dataset Open

The Online Conversation Threads Repository (Slashdot, Barrapunto, Wikipedia talk)

Creators

  • 1. Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona, Spain
  • 2. Barcelona Media – Innovation Centre Information, Technology and Society Group

Description

This repository contains datasets with online conversation threads collected and analyzed by different researchers. Currently, you can find datsets from different news aggregators (Slashdot, Barrapunto) and the English Wikipedia talk pages.

- Slashdot conversations (Aug 2005 - Aug 2006) Online conversations generated at Slashdot during a year. Posts and comments published between August 26th, 2005 and August 31th, 2006. For each discussion thread: sub-domains, title, topics and hierarchical relations between comments. For each comment: user, date, score and textual content. This dataset is different from the Slashdot Zoo social network (it is not a signed network of users) contained in the SNAP repository and represents the full version of the dataset used in the CAW 2.0 - Content Analysis for the WEB 2.0 workshop for the WWW 2009 conference that can be found in several repositories such as Konect Barrapunto conversations (Jan 2005 - Dec 2008)

- Online conversations generated at Barrapunto (Spanish clone of Slashdot) during three years. For each discussion thread: sub-domains, title, topics and hierarchical relations between comments. For each comment: user, date, score and textual content Wikipedia (2001 - Mar 2010)

- Data from articles discussions (talk) pages of the English Wikipedia as of March 2010. It contains comments on about 870,000 articles (i.e. all articles which had a corresponding talk page with at least one comment), in total about 9.4 million comments. The oldest comments date back to as early as 2001.

 

Notes

Contain: /slashdot slashdot_with_comments.tgz (518M): compressed file with raw xml tree-YY-MM.mat (128M): conversation threads in Matlab structures format Fields data : struct with fields ; post data id : string ; identifier of the post user : string ; writer of the news post date : double ; seconds topics : string ; main topics tree : struct with fields ; hierarchical structure of the thread data : comment data: id, parentid, score, user and date parent : index in tree(index) of the parent (-42 for the root node) depth : depth in the thread child : vector of children /barrapunto raw_xml.tgz (85M): compressed file with raw xml tree-YY.mat (22M): conversation threads in Matlab structures /wikipedia AllArticleTitles.csv.tar.gz (85M): compressed file with article titles all_comments.csv.tar.gz (1.6G): compressed file with comments WP_tree_raw_data_X.mat (87M): conversation threads in Matlab structures Software: Matlab This work is supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and co-financed by the Marie Curie FP7-PEOPLE-2012-COFUND Action. Grant agreement no: 600387

Files

README.txt

Files (2.5 GB)

Name Size Download all
md5:1a198c466a34e3ba38b106a0e693908f
111.0 MB Download
md5:411ec60c7ede8c42c27ec76a26221dd8
3.3 kB Preview Download
md5:3f75cc5bddfbd6ca7e0346e7214fb088
673.6 MB Download
md5:6da9215622016dc57df9766e6f3740f8
1.8 GB Download

Additional details

Related works

Is compiled by
10230/26817 (Handle)
10230/26746 (Handle)
10230/26816 (Handle)
Is identical to
10230/26270 (Handle)

Funding

UPFELLOWS – UPF Fellows 600387
European Commission

References

  • V. Gómez, A. Kaltenbrunner, V. López (2008) Statistical analysis of the social network and discussion threads in Slashdot. Proceedings of the 17th International World Wide Web Conference
  • V. Gómez, H. J. Kappen, N. Litvak, A. Kaltenbrunner (2013). A likelihood-based framework for the analysis of discussion threads. World Wide Web 16(5-6):645-675
  • D. Laniado, R. Tasso, Y. Volkovich, A. Kaltenbrunner (2011). When the Wikipedians Talk: Network and Tree Structure of Wikipedia Discussion Pages. Fifth International AAAI Conference on Weblogs and Social Media