Published May 8, 2023 | Version 1.0

Murreviikko: an Annotated and Normalized Corpus of Dialectal Finnish Tweets

Authors/Creators

  • 1. University of Helsinki

Description

Murreviikko (literally 'Dialect week') is a campaign founded in the University of Eastern Finland to promote the use of Finnish dialects in social media. It started in 2020 and takes place mid-October.

The original data was collected from Twitter with the search word murreviikko ('dialect week') and hashtag #murreviikko separately for 2020, 2021 and 2022. The current dataset combines all the original collections.

The tweets are dialectologically annotated on two levels: following the East-West division of Finnish dialects, and following a seven-way division of Finnish dialects (South-West, Häme, Southern Ostrobothnia, Central and Northern Ostrobothnia, Far North, Savo, and South-East), appended with the Helsinki slang. There is also a class for dialectal tweets, which are not discernible (NA) because of contrasting or scarce dialectal features.

The original tweets are normalized to a phonetic standard, but word order is not altered, or grammar rules of standard Finnish followed otherwise. This means that for instance standard Finnish possessive suffixes (minun kirja-ni 'my book-my') are not added if they are not present in the original tweet (minun kirja). Likewise, dialect words are not corrected to the standard alternative, even if such words would exist (pruukata > pruukata instead of standard tavata).

Following the rules of the Twitter API, this repository only includes the tweet id's, dialect annotations and normalizations. The original tweets are available for scientific use by request, as granted by the European Union’s Digital Single Market directive (2019/790).

Files

murreviikko_20_21_22.csv

Files (88.1 kB)

Name Size Download all
md5:c056c5a31c79d1a3d75301a4159ac65d
79.1 kB Preview Download
md5:850b77ef23a47a1fd1903a7f343f25b1
3.4 kB Download
md5:b2b4cd906fe05b49b033481622bae259
5.6 kB Preview Download

Additional details

Related works

Is published in
Conference paper: https://aclanthology.org/2023.vardial-1.3/ (URL)

Funding

Research Council of Finland
CorCoDial - Corpus-based computational dialectology: exploiting machine translation techniques to extract, visualize and interpret dialectal patterns 342859

References

  • Olli Kuparinen. 2023. Murreviikko - A Dialectologically Annotated and Normalized Dataset of Finnish Tweets. In Tenth Workshop on NLP for Similar Languages, Varieties and Dialects (VarDial 2023), pages 31–39, Dubrovnik, Croatia. Association for Computational Linguistics.