Dataset Open Access

DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text

Chakravarthi, Bharathi Raja; Priyadharshini, Ruba; Muralidaran, Vigneshwaran; Jose, Navya; Suryawanshi, Shardul; McCrae, John P.


Citation Style Language JSON Export

{
  "publisher": "Zenodo", 
  "DOI": "10.5281/zenodo.4750858", 
  "title": "DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text", 
  "issued": {
    "date-parts": [
      [
        2021, 
        5, 
        12
      ]
    ]
  }, 
  "abstract": "<p>This paper describes the development of a multilingual, manually annotated dataset for three under-resourced Dravidian languages generated from social media comments. The dataset was annotated for sentiment analysis and offensive language identification for a total of more than 60,000 YouTube comments. The dataset consists of around 44,000 comments in Tamil-English, around 7,000 comments in Kannada-English, and around 20,000 comments in Malayalam-English. The data was manually annotated by volunteer annotators and has a high inter-annotator agreement in Krippendorff&#39;s alpha. The dataset contains all types of code-mixing phenomena since it comprises user-generated content from a multilingual country.&nbsp; We also present baseline experiments to establish benchmarks on the dataset using machine learning methods.</p>\n\n<p>If you are using the data or code from this research then please site our paper below:</p>\n\n<p>@article{chakravarthi-etal-2021-lre,<br>\ntitle = &quot;DravidianCodeMix: Sentiment Analysis and Offensive Language Identification Dataset for Dravidian Languages in Code-Mixed Text&quot;,<br>\nauthor = &quot;Chakravarthi, Bharathi Raja&nbsp; and<br>\n&nbsp; Priyadharshini, Ruba&nbsp; and<br>\n&nbsp; Muralidaran, Vigneshwaran and<br>\n&nbsp; Jose, Navya and<br>\n&nbsp; Suryawanshi, Shardul and<br>\n&nbsp; Sherly, Elizabeth&nbsp; and<br>\n&nbsp; McCrae, John P<br>\n&nbsp; journal={Language Resources and Evaluation},<br>\n&nbsp; year={2021},<br>\n&nbsp; publisher={Springer}<br>\n}</p>\n\n<p>&nbsp;</p>", 
  "author": [
    {
      "family": "Chakravarthi, Bharathi Raja"
    }, 
    {
      "family": "Priyadharshini, Ruba"
    }, 
    {
      "family": "Muralidaran, Vigneshwaran"
    }, 
    {
      "family": "Jose, Navya"
    }, 
    {
      "family": "Suryawanshi, Shardul"
    }, 
    {
      "family": "McCrae, John P."
    }
  ], 
  "version": "1.0", 
  "type": "dataset", 
  "id": "4750858"
}
135
10
views
downloads
All versions This version
Views 135135
Downloads 1010
Data volume 107.9 MB107.9 MB
Unique views 111111
Unique downloads 1010

Share

Cite as