OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan
Description
OcWikiDisc is a freely available corpus in Occitan, extracted from the talk pages associated with the Occitan Wikipedia.
The corpus contains messages posted by users in direct user-to-user interactions as part of the discussions about the content and the editing policies on Wikipedia. The messages are associated with metadata, such as the username, the date and time of the posting, the discussion title, etc. The corpus has also been annotated with tools for automatic language identification, allowing to filter out content in languages other than Occitan. Using different filtering strategies, four versions of the corpus are published (see documentation for more details). The version with the most restrictive filtering contains 8,000 messages for a total of 618,000 tokens, produced by 520 different users.
Files
OcWikiDisc.zip
Files
(10.2 MB)
Name | Size | Download all |
---|---|---|
md5:05f0153a8800fc9c7a12a144baee5849
|
10.2 MB | Preview Download |
Additional details
Funding
- CorCoDial - Corpus-based computational dialectology: exploiting machine translation techniques to extract, visualize and interpret dialectal patterns 342859
- Research Council of Finland
References
- Aleksandra Miletić and Yves Scherrer. 2022. OcWikiDisc: a Corpus of Wikipedia Talk Pages in Occitan. In Proceedings of VarDial - Ninth Workshop on NLP for Similar Languages, Varieties and Dialects. (forthcoming)