Journal article Open Access

Automatic Detection of Online Abuse and Analysis of Problematic Users in Wikipedia

Rawat, Charu; Sarkar, Arnab; Singh, Sameer; Alvarado, Rafael; Rasberry, Lane

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.3101511</identifier>
      <creatorName>Rawat, Charu</creatorName>
      <affiliation>University of Virginia</affiliation>
      <creatorName>Sarkar, Arnab</creatorName>
      <affiliation>University of Virginia</affiliation>
      <creatorName>Singh, Sameer</creatorName>
      <affiliation>University of Virginia</affiliation>
      <creatorName>Alvarado, Rafael</creatorName>
      <affiliation>University of Virginia</affiliation>
      <creatorName>Rasberry, Lane</creatorName>
      <nameIdentifier nameIdentifierScheme="ORCID" schemeURI="">0000-0002-9485-6146</nameIdentifier>
      <affiliation>University of Virginia</affiliation>
    <title>Automatic Detection of Online Abuse and Analysis of Problematic Users in Wikipedia</title>
    <subject>Wikipedia, machine learning, misconduct, harassment, community moderation, Natural Language Processing</subject>
    <date dateType="Issued">2019-05-21</date>
  <resourceType resourceTypeGeneral="JournalArticle"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <relatedIdentifier relatedIdentifierType="DOI" relationType="IsVersionOf">10.5281/zenodo.3101510</relatedIdentifier>
    <relatedIdentifier relatedIdentifierType="URL" relationType="IsPartOf"></relatedIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;Today&amp;rsquo;s digital landscape is characterized by the pervasive presence of online communities. One of the persistent challenges to the ideal of free-flowing discourse in these communities has been online abuse. Wikipedia is a case in point, as it&amp;rsquo;s large community of contributors have experienced the perils of online abuse ranging from hateful speech to personal attacks to spam. Currently, Wikipedia has a human-driven process in place to identify online abuse. In this paper, we propose a framework to understand and detect such abuse in the English Wikipedia community. We analyze the publicly available data sources provided by Wikipedia. We discover that Wikipedia&amp;rsquo;s XML dumps require extensive computing power to be used for temporal textual analysis, and, as an alternative, we propose a web scraping methodology to extract user-level data and perform extensive exploratory data analysis to understand the characteristics of users who have been blocked for abusive behavior in the past. With these data, we develop an abuse detection model that leverages Natural Language Processing techniques, such as character and word n-grams, sentiment analysis and topic modeling, and generates features that are used as inputs in a model based on machine learning algorithms to predict abusive behavior. Our best abuse detection model, using XGBoost Classifier, gives us an AUC of ~84%.&lt;/p&gt;</description>
All versions This version
Views 269270
Downloads 100100
Data volume 41.6 MB41.6 MB
Unique views 243244
Unique downloads 9797


Cite as