Dataset Open Access

Webis YouTube 8M Augmented 2018

Jiani Qu; Anny Marleen Hißbach; Tim Gollub; Martin Potthast

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.3724807</identifier>
      <creatorName>Jiani Qu</creatorName>
      <affiliation>Bauhaus-Universität Weimar</affiliation>
      <creatorName>Anny Marleen Hißbach</creatorName>
      <affiliation>Bauhaus-Universität Weimar</affiliation>
      <creatorName>Tim Gollub</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0003-1737-6517</nameIdentifier>
      <affiliation>Bauhaus-Universität Weimar</affiliation>
      <creatorName>Martin Potthast</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0003-2451-0665</nameIdentifier>
      <affiliation>Leipzig University</affiliation>
    <title>Webis YouTube 8M Augmented 2018</title>
    <date dateType="Issued">2018-07-05</date>
  <resourceType resourceTypeGeneral="Dataset"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.3724806</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;We used the YouTube Data API&amp;nbsp;to augment the&amp;nbsp;&lt;a href=""&gt;YouTube 8M&lt;/a&gt;&amp;nbsp;corpus by crawling a variety of meta data for the videos.&lt;/p&gt;

&lt;p&gt;First point of interest was the &amp;quot;video resource,&amp;quot;&amp;nbsp;which comprises data about the video, such as the video&amp;rsquo;s title, description, uploader name, tags, view count, and more. Also included in the meta data is whether comments have been left for the video. If so, we downloaded them as well, including information about their authors, likes, dislikes, and responses.&lt;/p&gt;

&lt;p&gt;There is no property which specifies a video&amp;rsquo;s&amp;nbsp;language, since this information is not mandatory when uploading a video. Also, the API provides only information about the available captions, but not the captions themselves. Only the uploader of a video is given access to its captions via the API; we extracted them using &lt;a href=""&gt;youtube-dl&lt;/a&gt;.&amp;nbsp;For each video, all manually created captions were downloaded, and auto-generated captions in the &amp;quot;default&amp;quot;&amp;nbsp;language and English. The &amp;quot;default&amp;quot;&amp;nbsp;auto-generated caption gives perhaps the only hint at a video&amp;rsquo;s original language.&lt;/p&gt;

&lt;p&gt;Finally, we downloaded all thumbnails used to advertise a video, which are not available via the API, but only via a canonical URL. Our corpus provides the possibility to recreate the way a video is presented on YouTube (meta data and thumbnail), what the actual content is ((sub)titles and descriptions), and how its viewers reacted (comments).&lt;br&gt;
If you use this dataset in your publication, &lt;strong&gt;please cite the dataset as outlined in the right column.&lt;/strong&gt;&lt;/p&gt;</description>
All versions This version
Views 301301
Downloads 258258
Data volume 19.5 TB19.5 TB
Unique views 271271
Unique downloads 169169


Cite as