There is a newer version of this record available.

Dataset Open Access

LatinISE subcorpora for SemEval 2020 task 1

McGillivray, Barbara; Schlechtweg, Dominik; Dubossarsky, Haim; Tahmasebi, Nina; Hengchen, Simon

This data collection contains the Latin test data for SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection]: 

  • a Latin text corpus pair (`corpus1/`, `corpus2/`)
  • 40 lemmas which have been annotated for their lexical semantic change between the two corpora (`targets.txt`)

The corpus data have been automatically lemmatized and part-of-speech tagged, and have been partially corrected by hand. For homonyms, the lemmas are followed by the '\#' symbol and the number of the homonym according to the Lewis-Short dictionary of Latin when this number is greater than 1. For example, the lemma 'dico' corresponds to the first homonym in the Lewis-Short dictionary and 'dico\#2' corresponds to the second homonym, cf. Lewis-Short dictionary.

__Corpus 1__

  • based on: LatinISE (McGillivray and Kilgarriff 2013), version on Sketch Engine
  • language: Latin
  • time covered: from the beginning of the second century before Christ (BC) to the end of the first century BC
  • size: ~1.7 million tokens
  • format: lemmatized, sentence length >= 2, no punctuation, sentences randomly shuffled
  • encoding: UTF-8

__Corpus 2__

  • based on: LatinISE (McGillivray and Kilgarriff 2013) , version on Sketch Engine
  • language: Latin
  • time covered: from the beginning of the first century after Christ (AD) to the end of the twenty-first century AD
  • size: ~9.4 million tokens
  • format: lemmatized, sentence length >= 2, no punctuation, sentences randomly shuffled
  • encoding: UTF-8

Find more information on the data in the papers referenced below.

References

Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky and Nina Tahmasebi SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection. To appear in SemEval@COLING2020.

McGillivray, B. and Kilgarriff, A. (2013). Tools for historical corpus research, and a corpus of Latin. In Paul Bennett, Martin Durrell, Silke Scheible, Richard J. Whitt (eds.), New Methods in Historical Corpus Linguistics, Tübingen: Narr.
 

Files (28.4 MB)
Name Size
semeval2020_ulscd_lat.zip
md5:3a468b842221bb92dbd778a7f8ee2ac1
28.4 MB Download
398
353
views
downloads
All versions This version
Views 398262
Downloads 353221
Data volume 10.3 GB6.3 GB
Unique views 307233
Unique downloads 290206

Share

Cite as