Dataset Open Access

DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text

Chakravarthi, Bharathi Raja; Priyadharshini, Ruba; Muralidaran, Vigneshwaran; Jose, Navya; Suryawanshi, Shardul; McCrae, John P.


Dublin Core Export

<?xml version='1.0' encoding='utf-8'?>
<oai_dc:dc xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:oai_dc="http://www.openarchives.org/OAI/2.0/oai_dc/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.openarchives.org/OAI/2.0/oai_dc/ http://www.openarchives.org/OAI/2.0/oai_dc.xsd">
  <dc:creator>Chakravarthi, Bharathi Raja</dc:creator>
  <dc:creator>Priyadharshini, Ruba</dc:creator>
  <dc:creator>Muralidaran, Vigneshwaran</dc:creator>
  <dc:creator>Jose, Navya</dc:creator>
  <dc:creator>Suryawanshi, Shardul</dc:creator>
  <dc:creator>McCrae, John P.</dc:creator>
  <dc:date>2021-05-12</dc:date>
  <dc:description>This paper describes the development of a multilingual, manually annotated dataset for three under-resourced Dravidian languages generated from social media comments. The dataset was annotated for sentiment analysis and offensive language identification for a total of more than 60,000 YouTube comments. The dataset consists of around 44,000 comments in Tamil-English, around 7,000 comments in Kannada-English, and around 20,000 comments in Malayalam-English. The data was manually annotated by volunteer annotators and has a high inter-annotator agreement in Krippendorff's alpha. The dataset contains all types of code-mixing phenomena since it comprises user-generated content from a multilingual country.  We also present baseline experiments to establish benchmarks on the dataset using machine learning methods.

If you are using the data or code from this research then please site our paper below:

@article{chakravarthi-etal-2021-lre,
title = "DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text",
author = "Chakravarthi, Bharathi Raja  and
  Priyadharshini, Ruba  and
  Muralidaran, Vigneshwaran and
  Jose, Navya and
  Suryawanshi, Shardul and
  Sherly, Elizabeth  and
  McCrae, John P
  journal={Language Resources and Evaluation},
  year={2021},
  publisher={Springer}
}

 </dc:description>
  <dc:identifier>https://zenodo.org/record/4750858</dc:identifier>
  <dc:identifier>10.5281/zenodo.4750858</dc:identifier>
  <dc:identifier>oai:zenodo.org:4750858</dc:identifier>
  <dc:relation>doi:10.5281/zenodo.4750857</dc:relation>
  <dc:rights>info:eu-repo/semantics/openAccess</dc:rights>
  <dc:rights>https://creativecommons.org/licenses/by/4.0/legalcode</dc:rights>
  <dc:subject>Tamil, Malayalam, Kannada, Dravidian languages, Sentiment Analysis, Offensive langauge identification, Code-mixed, corpora</dc:subject>
  <dc:title>DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text</dc:title>
  <dc:type>info:eu-repo/semantics/other</dc:type>
  <dc:type>dataset</dc:type>
</oai_dc:dc>
147
10
views
downloads
All versions This version
Views 147147
Downloads 1010
Data volume 107.9 MB107.9 MB
Unique views 123123
Unique downloads 1010

Share

Cite as