Dataset Open Access

Russian Distributional Thesaurus (RDT): Word Embeddings

Alexander Panchenko; Nikolay Arefyev; Dmitry Ustalov; Natalia Loukachevitch; Denis Paperno; Chris Biemann; Natalia Konstantinova

DataCite XML Export

<?xml version='1.0' encoding='utf-8'?>
<resource xmlns:xsi="" xmlns="" xsi:schemaLocation="">
  <identifier identifierType="DOI">10.5281/zenodo.400631</identifier>
      <creatorName>Alexander Panchenko</creatorName>
      <affiliation>University of Hamburg</affiliation>
      <creatorName>Nikolay Arefyev</creatorName>
      <affiliation>Moscow State University</affiliation>
      <creatorName>Dmitry Ustalov</creatorName>
      <affiliation>Ural Federal Univerisity</affiliation>
      <creatorName>Natalia Loukachevitch</creatorName>
      <affiliation>Moscow State University</affiliation>
      <creatorName>Denis Paperno</creatorName>
      <affiliation>University of Trento</affiliation>
      <creatorName>Chris Biemann</creatorName>
      <affiliation>University of Hamburg</affiliation>
      <creatorName>Natalia Konstantinova</creatorName>
      <affiliation>University of Wolverhampton</affiliation>
    <title>Russian Distributional Thesaurus (RDT): Word Embeddings</title>
    <subject>word embeddings</subject>
    <subject>distributional semantics</subject>
    <subject>Russian language</subject>
    <subject>word vectors</subject>
    <date dateType="Issued">2017-03-18</date>
  <resourceType resourceTypeGeneral="Dataset"/>
    <alternateIdentifier alternateIdentifierType="url"></alternateIdentifier>
    <rights rightsURI="">Creative Commons Attribution 4.0 International</rights>
    <rights rightsURI="info:eu-repo/semantics/openAccess">Open Access</rights>
    <description descriptionType="Abstract">&lt;p&gt;This resource is a part of the Russian Distributional Thesaurus (RDT): see and &lt;/p&gt;

&lt;p&gt;This dataset contains a large scale word embeddings model for Russian trained using the SGNS model (Mikolov et al., 2013) on a 12.9 billion word collection of books in Russian. According to the results of our participation in the shared task on Russian semantic similarity (Panchenko et al., 2015), this approach scored in the top 5 among 105 submissions (Arefyev et al., 2015). Following our prior experiments (Arefyev et al., 2015) we have selected the following parameters for the model: minimal word frequency – 5, number of dimensions in a word vector – 500, three or five iterations of the learning algorithm over the input corpus, context window size of 1, 2, 3, 5, 7 and 10 words. Parameters of the model are listed below:&lt;/p&gt;

	&lt;li&gt;Model: skip-gram&lt;/li&gt;
	&lt;li&gt;Corpus: a 150Gb sample of the book collection.&lt;/li&gt;
	&lt;li&gt;Context window size: 10 words&lt;/li&gt;
	&lt;li&gt;Number of dimensions: 500&lt;/li&gt;
	&lt;li&gt;Number of iterations: 3&lt;/li&gt;
	&lt;li&gt;Minimal word frequency: 5&lt;/li&gt;


	&lt;li&gt;Panchenko A., Ustalov D., Arefyev N., Paperno D., Konstantinova N., Loukachevitch N. and Biemann C. (2016): Human and Machine Judgements about Russian Semantic Relatedness. In Proceedings of the 5th Conference on Analysis of Images, Social Networks, and Texts (AIST'2016). Communications in Computer and Information Science (CCIS). Springer-Verlag Berlin Heidelberg&lt;/li&gt;

	&lt;li&gt;Panchenko A., Loukachevitch N. V., Ustalov D., Paperno D., Meyer C. M., Konstantinova N. (2015): RUSSE: The First International Workshop on Russian Semantic Similarity. In Proceedings of the 21st International Conference on Computational Linguistics and Intellectual Technologies (Dialogue'2015). Moscow, Russia. RGGU&lt;/li&gt;

	&lt;li&gt;Arefyev N., Panchenko A., Lukanin A., Lesota O., Romanov P. (2015): Evaluating Three Corpus-Based Semantic Similarity Systems for Russian. In Proceedings of the 21st International Conference on Computational Linguistics and Intellectual Technologies (Dialogue'2015). Moscow, Russia. RGGU&lt;/li&gt;
All versions This version
Views 298298
Downloads 7272
Data volume 1.1 TB1.1 TB
Unique views 283283
Unique downloads 6161


Cite as