Dataset Open Access

Webis Clickbait Corpus 2017 (Webis-Clickbait-17)

Potthast, Martin; Gollub, Tim; Wiegmann, Matti; Stein, Benno; Hagen, Matthias; Komlossy, Kristof; Schuster, Sebstian; Fernandez, Erika P. Garces

The Webis Clickbait Corpus 2017 (Webis-Clickbait-17) comprises a total of 38,517 Twitter posts from 27 major US news publishers. In addition to the posts, information about the articles linked in the posts are included. The posts had been published between November 2016 and June 2017. To avoid publisher and topical biases, a maximum of ten posts per day and publisher were sampled. All posts were annotated on a 4-point scale [not click baiting (0.0), slightly click baiting (0.33), considerably click baiting (0.66), heavily click baiting (1.0)] by five annotators from Amazon Mechanical Turk. A total of 9,276 posts are considered clickbait by the majority of annotators. In terms of its size, this corpus outranges the Webis Clickbait Corpus 2016 by one order of magnitude. The corpus is divided into two logical parts, a training and a test dataset. The training dataset has been released in the course of the Clickbait Challenge and a download link is provided below. To allow for an objective evaulatuion of clickbait detection systems, the test dataset is available only through the Evaluation-as-a-Service platform TIRA at the moment. On TIRA, developers can deploy clickbait detection systems and execute them against the test dataset. The performance of the submitted systems can be viewed on the TIRA page of the Clickbait Challenge.

To make working with the Webis Clickbait Corpus 2017 convenient, and to allow for its validation and replication, we are developing and sharing a number of software tags:

  • Corpus Viewer. Our Django web service for exploring corpora. For importing the Webis Clickbait Corpus 2017 into the corpus viewer, we provide an appropriate configuration file.
  • MTurk Manager. Our Django web service for conducting sophisticated crowd sourcing tasks on Amazon Mechanical Turk. The service allows to manage projects, upload batches of HITS, apply custom reviewing interfaces, and more. To make the clickbait crowd-sourcing task replicable, we share the worker template that we used to instruct the workers and to display the tweets. Also shared is a reviewing template that can be used to accept/reject assignments and to assess the quality of the received annotations quickly.
  • Web Archiver. Software for archiving web pages as WARC files and reproducing them later on. This software can be used to open the WARC archives provided above.

In addition to the corpus "clickbait17-train-170630.zip", we provide the original WARC archives of the articles that are linked in the posts. They are split in 5 archives that can be extracted separately.

Files (103.1 GB)
Name Size
archives-clickbait17-train-170630-part[00-19].zip
md5:b77ff5d5d2d2e8d61e63ee4e871a49f4
20.6 GB Download
archives-clickbait17-train-170630-part[20-39].zip
md5:0e12b8552a52eed2fa24649944a026d5
20.6 GB Download
archives-clickbait17-train-170630-part[40-59].zip
md5:be6fa68e00fc5f7de062f7b5541aa3d5
20.9 GB Download
archives-clickbait17-train-170630-part[60-79].zip
md5:e7cbc10d83a249169d4a6366dc742e88
20.4 GB Download
archives-clickbait17-train-170630-part[80-99].zip
md5:632a198444d66756c356d8e92c287101
19.6 GB Download
clickbait17-train-170630.zip
md5:8f074f3f035393b81a559bfc8bd9a467
937.1 MB Download
18
14
views
downloads
All versions This version
Views 1818
Downloads 1414
Data volume 268.7 GB268.7 GB
Unique views 1818
Unique downloads 33

Share

Cite as