Lists of Uzbek Stopwords
- 1. Urgench state university
- 2. University of Primorska, UPFAMNIT
Contributors
Contact person:
Data collector:
Data manager:
- 1. Urgench state university
- 2. University of Primorska, UPFAMNIT
Description
The dataset presents 3 lists of stopwords in Uzbek language. The lists were constructed using three automatic methods applied to the same corpus.
The corpus was also constructed by obtaining a source of 25 school textbooks, it was named "School corpus". Total number of words in the "School corpus" is 731156. And them 47165 words are unique words.
Description of the methods and the lists:
A set of grammar rules and the TDIDF algorithm was used to automatically collect a list of single-word stopwords. 2357 stopwords were collected. The name of the file: stopwords_unigrams.txt.
A bigram method was used to extract a list of 4548 bigrams (pairs) of stopwords. The name of the file: stopwords_bigrams.txt.
A set of two-word collocations as stopwords was also extracted. The list has 24490 pairs of stopwords. The name of the file: stopwords_bigrams_with_collocations.txt.
Files
uzbek_stopwords.zip
Files
(256.4 kB)
Name | Size | Download all |
---|---|---|
md5:4f3bc7bf68e4fe48844b723d4904bb3b
|
256.4 kB | Preview Download |