Published September 14, 2022 | Version 1.0
Dataset Open

OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan

  • 1. University of Helsinki

Description

OcWikiDisc is a freely available corpus in Occitan, extracted from the talk pages associated with the Occitan Wikipedia.

The corpus contains messages posted by users in direct user-to-user interactions as part of the discussions about the content and the editing policies on Wikipedia. The messages are associated with metadata, such as the username, the date and time of the posting, the discussion title, etc. The corpus has also been annotated with tools for automatic language identification, allowing to filter out content in languages other than Occitan. Using different filtering strategies, four versions of the corpus are published (see documentation for more details). The version with the most restrictive filtering contains 8,000 messages for a total of 618,000 tokens, produced by 520 different users.

Files

OcWikiDisc.zip

Files (10.2 MB)

Name Size Download all
md5:05f0153a8800fc9c7a12a144baee5849
10.2 MB Preview Download

Additional details

Funding

CorCoDial - Corpus-based computational dialectology: exploiting machine translation techniques to extract, visualize and interpret dialectal patterns 342859
Research Council of Finland

References

  • Aleksandra Miletić and Yves Scherrer. 2022. OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan. In Proceedings of VarDial - Ninth Workshop on NLP for Similar Languages, Varieties and Dialects. (forthcoming)