Dataset Open Access

PAN Wikipedia Vandalism Corpus 2010 (PAN-WVC-10)

Potthast, Martin; Stein, Benno; Holfeld, Teresa

The PAN Wikipedia Vvandalism Ccorpus 2010 (PAN-WVC-10) is a corpus for the evaluation of automatic vandalism detectors for Wikipedia. For research purposes the corpus can be used free of charge.

This corpus is supplemented by the PAN-WVC-11, which features additional edits in English, Spanish and German. Both corpora should be used to get more representative results.

As part of our research on automatic vandalism detection we have compiled a corpus of vandalism cases found in Wikipedia. The corpus compiles 32452 edits on 28468 Wikipedia articles, among which 2391 vandalism edits have been identified. To annotate the corpus we have used Amazon's Mechanical Turk; 753 workers have been recruited who cast more than 150000 votes on the edits, so that each edit was reviewed by at least 3 annotators. The achieved level of agreement was analyzed in order to label an edit as "regular" or "vandalism."

Files (459.4 MB)
Name Size
pan-wikipedia-vandalism-corpus-2010.zip
md5:fed384796c5cdb066d2ab9d1c0ec7764
459.4 MB Download
  • Martin Potthast. Crowdsourcing a Wikipedia Vandalism Corpus. In Fabio Crestani et al, editors, 33rd International ACM Conference on Research and Development in Information Retrieval (SIGIR 2010), pages 789-790, July 2010. ACM. ISBN 978-1-4503-0153-4.

19
5
views
downloads
All versions This version
Views 1919
Downloads 55
Data volume 2.3 GB2.3 GB
Unique views 1414
Unique downloads 44

Share

Cite as