There is a newer version of this record available.

Software Open Access

Software for: "It is just a flu: Assessing the Effect of Watch History on YouTube's Pseudoscientific Video Recommendations"

Kostantinos Papadamou; Savvas Zannettou; Jeremy Blackburn; Emiliano De Cristofaro; Gianluca Stringhini; Michael Sirivianos


Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Kostantinos Papadamou</dc:creator>
  <dc:creator>Savvas Zannettou</dc:creator>
  <dc:creator>Jeremy Blackburn</dc:creator>
  <dc:creator>Emiliano De Cristofaro</dc:creator>
  <dc:creator>Gianluca Stringhini</dc:creator>
  <dc:creator>Michael Sirivianos</dc:creator>
  <dc:date>2021-03-04</dc:date>
  <dc:description>Abstract: The role played by YouTube's recommendation algorithm in unwittingly promoting misinformation and conspiracy theories is not entirely understood. Yet, this can have dire real-world consequences, especially when pseudoscientific content is promoted to users at critical times, such as the COVID-19 pandemic. In this paper, we set out to characterize and detect pseudoscientific misinformation on YouTube. We collect 6.6K videos related to COVID-19, the Flat Earth theory, as well as the anti-vaccination and anti-mask movements. Using crowdsourcing, we annotate them as pseudoscience, legitimate science, or irrelevant and train a deep learning classifier to detect pseudoscientific videos with an accuracy of 0.79. We quantify user exposure to this content on various parts of the platform and how this exposure changes based on the user's watch history. We find that YouTube suggests more pseudoscientific content regarding traditional pseudoscientific topics (e.g., flat earth, anti-vaccination) than for emerging ones (like COVID-19). At the same time, these recommendations are more common on the search results page than on a user's homepage or when actively watching videos. Finally, we shed light on how a user's watch history substantially affects the type of recommended videos.

Preprint available here.

What do we offer in this software?

We make publicly available to the research community, as well as the open-source community, the following tools, and libraries:


	
	The codebase of a Deep Learning Classifier for pseudoscientific videos detection on YouTube, and examples on how to train and test it;
	
	
	A library that simplifies the usage of the trained classifier and implements all the required tasks for the classification of YouTube videos;
	
	
	An open-source library that provides a unified framework for assessing the effects of personalization on YouTube video recommendations in multiple parts of the platform: a) the homepage; b) the search results page; and c) the video recommendations section (recommendations when watching videos).
	


The codebase is also available on GitHub.

If you make use of any modules available in this codebase in your work, please cite the following paper:

@article{papadamou2020just,
  title={"It is just a flu": Assessing the Effect of Watch History on YouTube's Pseudoscientific Video Recommendations},
  author={Papadamou, Kostantinos and Zannettou, Savvas and Blackburn, Jeremy and De Cristofaro, Emiliano and Stringhini, Gianluca and Sirivianos, Michael},
  journal={arXiv preprint arXiv:2010.11638},
  year={2020}
}

 </dc:description>
  <dc:description>Acknowledgments: This project has received funding from the European Union's Horizon 2020 Research and Innovation program under the Marie Skłodowska-Curie ENCASE project (Grant Agreement No. 691025) and from the National Science Foundation under grant CNS-1942610.</dc:description>
  <dc:identifier>https://zenodo.org/record/4580892</dc:identifier>
  <dc:identifier>10.5281/zenodo.4580892</dc:identifier>
  <dc:identifier>oai:zenodo.org:4580892</dc:identifier>
  <dc:relation>info:eu-repo/grantAgreement/EC/H2020/830927/</dc:relation>
  <dc:relation>doi:10.5281/zenodo.4484045</dc:relation>
  <dc:relation>doi:10.5281/zenodo.4558469</dc:relation>
  <dc:relation>doi:10.5281/zenodo.4580891</dc:relation>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>https://creativecommons.org/licenses/by/4.0/legalcode</dc:rights>
  <dc:subject>YouTube</dc:subject>
  <dc:subject>YouTube Videos</dc:subject>
  <dc:subject>YouTube's Recommendation Algorithm</dc:subject>
  <dc:subject>Science</dc:subject>
  <dc:subject>Pseudoscience</dc:subject>
  <dc:subject>Pseudoscientific Misinformation</dc:subject>
  <dc:subject>Watch History</dc:subject>
  <dc:subject>COVID-19</dc:subject>
  <dc:subject>Anti-vaccination</dc:subject>
  <dc:subject>Anti-mask</dc:subject>
  <dc:subject>Flat Earth</dc:subject>
  <dc:title>Software for: "It is just a flu: Assessing the Effect of Watch History on YouTube's Pseudoscientific Video Recommendations"</dc:title>
  <dc:type>info:eu-repo/semantics/other</dc:type>
  <dc:type>software</dc:type>
</oai_dc:dc>
77
3
views
downloads
All versions This version
Views 7720
Downloads 30
Data volume 948.7 kB0 Bytes
Unique views 6019
Unique downloads 30

Share

Cite as