PAN Wikipedia Vandalism Corpus 2010 (PAN-WVC-10)
Description
The PAN Wikipedia Vvandalism Ccorpus 2010 (PAN-WVC-10) is a corpus for the evaluation of automatic vandalism detectors for Wikipedia. For research purposes the corpus can be used free of charge.
This corpus is supplemented by the PAN-WVC-11, which features additional edits in English, Spanish and German. Both corpora should be used to get more representative results.
As part of our research on automatic vandalism detection we have compiled a corpus of vandalism cases found in Wikipedia. The corpus compiles 32452 edits on 28468 Wikipedia articles, among which 2391 vandalism edits have been identified. To annotate the corpus we have used Amazon's Mechanical Turk; 753 workers have been recruited who cast more than 150000 votes on the edits, so that each edit was reviewed by at least 3 annotators. The achieved level of agreement was analyzed in order to label an edit as "regular" or "vandalism."
Files
pan-wikipedia-vandalism-corpus-2010.zip
Files
(459.4 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:fed384796c5cdb066d2ab9d1c0ec7764
|
459.4 MB | Preview Download |
Additional details
References
- Martin Potthast. Crowdsourcing a Wikipedia Vandalism Corpus. In Fabio Crestani et al, editors, 33rd International ACM Conference on Research and Development in Information Retrieval (SIGIR 2010), pages 789-790, July 2010. ACM. ISBN 978-1-4503-0153-4.