Published November 13, 2020 | Version 01
Dataset Open

Tunizi: Tunisian Arabizi Sentiment Analysis Dataset

  • 1. iCompass

Description

Tunizi is the first 100% Tunisian Arabizi sentiment analysis dataset. Tunisian Arabizi is the representation of the tunisian dialect written in Latin characters and numbers rather than Arabic letters.We gathered comments from social media platforms that express sentiment about popular topics. For this purpose, we extracted 100k comments using public streaming APIs.  Tunizi was preprocessed by removing links, emoji symbols, and punctuations.

The collected comments were manually annotated using an overall polarity:   positive (1), negative (-1) and neutral (0) class.   We divided the dataset into separate training, validation and test sets, with a ratio of 7:1:2  with a balanced split where the number of comments from positive class and negative class are almost the same.

Notes

This dataset contains comments written in Tunisian Arabizi which represents the Tunisian dialect written in Latin letters and numbers.

Files

Files (4.7 MB)

Name Size Download all
md5:5be37f4fa75cc3b5af5860f4504cdcc9
4.7 MB Download