Lists of Uzbek Stopwords

The dataset presents 3 lists of stopwords in the Uzbek language. The lists were constructed using three automatic methods applied to the same corpus. 

The corpus was constructed by obtaining a source of 25 school textbooks, it was named "School corpus". The total number of words in the "School corpus" is 731156. And them 47165 words are unique words. The corpus can be re-constructed using the list of urls of all files comprised in the corpus. The list is part of the dataset (list_of_urls_of_school_corpus.txt).

Description of the methods and the lists:

A set of grammar rules and the TDIDF algorithm was used to automatically collect a list of single-word stopwords. 2357 stopwords were collected. The name of the file: stopwords_unigrams.txt.

A bigram method was used to extract a list of 4548 bigrams (pairs) of stopwords. The name of the file: stopwords_bigrams.txt.

A set of two-word collocations as stopwords was also extracted. The list has 24490 pairs of stopwords. The name of the file: stopwords_bigrams_with_collocations.txt.