Dataset Open Access

Webis YouTube 8M Augmented 2018

Jiani Qu; Anny Marleen Hißbach; Tim Gollub; Martin Potthast

Citation Style Language JSON Export

  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.3724807", 
  "title": "Webis YouTube 8M Augmented 2018", 
  "issued": {
    "date-parts": [
  "abstract": "<p>We used the YouTube Data API&nbsp;to augment the&nbsp;<a href=\"\">YouTube 8M</a>&nbsp;corpus by crawling a variety of meta data for the videos.</p>\n\n<p>First point of interest was the &quot;video resource,&quot;&nbsp;which comprises data about the video, such as the video&rsquo;s title, description, uploader name, tags, view count, and more. Also included in the meta data is whether comments have been left for the video. If so, we downloaded them as well, including information about their authors, likes, dislikes, and responses.</p>\n\n<p>There is no property which specifies a video&rsquo;s&nbsp;language, since this information is not mandatory when uploading a video. Also, the API provides only information about the available captions, but not the captions themselves. Only the uploader of a video is given access to its captions via the API; we extracted them using <a href=\"\">youtube-dl</a>.&nbsp;For each video, all manually created captions were downloaded, and auto-generated captions in the &quot;default&quot;&nbsp;language and English. The &quot;default&quot;&nbsp;auto-generated caption gives perhaps the only hint at a video&rsquo;s original language.</p>\n\n<p>Finally, we downloaded all thumbnails used to advertise a video, which are not available via the API, but only via a canonical URL. Our corpus provides the possibility to recreate the way a video is presented on YouTube (meta data and thumbnail), what the actual content is ((sub)titles and descriptions), and how its viewers reacted (comments).<br>\n<br>\nIf you use this dataset in your publication, <strong>please cite the dataset as outlined in the right column.</strong></p>", 
  "author": [
      "family": "Jiani Qu"
      "family": "Anny Marleen Hi\u00dfbach"
      "family": "Tim Gollub"
      "family": "Martin Potthast"
  "id": "3724807", 
  "event-place": "Zurich", 
  "type": "dataset", 
  "event": "The Sixth AAAI Conference on Human Computation and Crowdsourcing (HCOMP)"
All versions This version
Views 301301
Downloads 258258
Data volume 19.5 TB19.5 TB
Unique views 271271
Unique downloads 169169


Cite as