There is a newer version of the record available.

Published November 9, 2021 | Version 1
Dataset Open

Lists of Uzbek Stopwords

  • 1. Urgench state university
  • 2. University of Primorska, UPFAMNIT

Contributors

Contact person:

Data collector:

Data manager:

  • 1. Urgench state university
  • 2. University of Primorska, UPFAMNIT

Description

The dataset presents 3 lists of stopwords in Uzbek language. The lists were constructed using three automatic methods applied to the same corpus. 

The corpus was also constructed by obtaining a source of 25 school textbooks, it was named "School corpus". Total number of words in the "School corpus" is 731156. And them 47165 words are unique words. 

Description of the methods and the lists:

A set of grammar rules and the TDIDF algorithm was used to automatically collect a list of single-word stopwords. 2357 stopwords were collected. The name of the file: stopwords_unigrams.txt.

A bigram method was used to extract a list of 4548 bigrams (pairs) of stopwords. The name of the file: stopwords_bigrams.txt.

A set of two-word collocations as stopwords was also extracted. The list has 24490 pairs of stopwords. The name of the file: stopwords_bigrams_with_collocations.txt.

Files

uzbek_stopwords.zip

Files (256.4 kB)

Name Size Download all
md5:4f3bc7bf68e4fe48844b723d4904bb3b
256.4 kB Preview Download