Published January 7, 2018
| Version 1.0.0
Dataset
Open
WiLI-2018 - Wikipedia Language Identification database
Authors/Creators
Description
WiLI-2018, the Wikipedia language identification benchmark dataset, contains 235000 paragraphs of 235 languages. The dataset is balanced and a train-test split is provided.
See "The WiLI benchmark dataset for written language identification" paper (soon on arXiv) for more information.