There is a newer version of this record available.

Dataset Open Access

LatinISE test data for SemEval 2020 task 1

McGillivray, Barbara; Schlechtweg, Dominik; Dubossarsky, Haim; Tahmasebi, Nina; Hengchen, Simon


MARC21 XML Export

<?xml version='1.0' encoding='UTF-8'?>
<record xmlns="http://www.loc.gov/MARC21/slim">
  <leader>00000nmm##2200000uu#4500</leader>
  <datafield tag="041" ind1=" " ind2=" ">
    <subfield code="a">lat</subfield>
  </datafield>
  <datafield tag="653" ind1=" " ind2=" ">
    <subfield code="a">Latin, corpus</subfield>
  </datafield>
  <controlfield tag="005">20200820140218.0</controlfield>
  <controlfield tag="001">3734089</controlfield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">IMS, University of Stuttgart</subfield>
    <subfield code="a">Schlechtweg, Dominik</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Cambridge</subfield>
    <subfield code="a">Dubossarsky, Haim</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Gothenburg</subfield>
    <subfield code="a">Tahmasebi, Nina</subfield>
  </datafield>
  <datafield tag="700" ind1=" " ind2=" ">
    <subfield code="u">University of Helsinki</subfield>
    <subfield code="a">Hengchen, Simon</subfield>
  </datafield>
  <datafield tag="856" ind1="4" ind2=" ">
    <subfield code="s">28445562</subfield>
    <subfield code="z">md5:e7c60d2877d8f7b00ac60f2dab4a66f0</subfield>
    <subfield code="u">https://zenodo.org/record/3734089/files/semeval2020_ulscd_lat.zip</subfield>
  </datafield>
  <datafield tag="542" ind1=" " ind2=" ">
    <subfield code="l">open</subfield>
  </datafield>
  <datafield tag="260" ind1=" " ind2=" ">
    <subfield code="c">2020-03-31</subfield>
  </datafield>
  <datafield tag="909" ind1="C" ind2="O">
    <subfield code="p">openaire_data</subfield>
    <subfield code="o">oai:zenodo.org:3734089</subfield>
  </datafield>
  <datafield tag="100" ind1=" " ind2=" ">
    <subfield code="u">University of Cambridge</subfield>
    <subfield code="a">McGillivray, Barbara</subfield>
  </datafield>
  <datafield tag="245" ind1=" " ind2=" ">
    <subfield code="a">LatinISE test data for SemEval 2020 task 1</subfield>
  </datafield>
  <datafield tag="536" ind1=" " ind2=" ">
    <subfield code="c">EP/N510129/1</subfield>
    <subfield code="a">The Alan Turing Institute</subfield>
  </datafield>
  <datafield tag="540" ind1=" " ind2=" ">
    <subfield code="u">https://creativecommons.org/licenses/by/4.0/legalcode</subfield>
    <subfield code="a">Creative Commons Attribution 4.0 International</subfield>
  </datafield>
  <datafield tag="650" ind1="1" ind2="7">
    <subfield code="a">cc-by</subfield>
    <subfield code="2">opendefinition.org</subfield>
  </datafield>
  <datafield tag="520" ind1=" " ind2=" ">
    <subfield code="a">&lt;p&gt;This data collection contains the Latin test data for &lt;a href="https://competitions.codalab.org/competitions/20948"&gt;SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection&lt;/a&gt;:&amp;nbsp;&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;a Latin text corpus pair (`corpus1/lemma`, `corpus2/lemma`)&lt;/li&gt;
	&lt;li&gt;40 lemmas which have been annotated for their lexical semantic change between the two corpora (`targets.txt`)&lt;/li&gt;
	&lt;li&gt;the annotated binary change scores of the targets for subtask 1, and their annotated graded change scores for subtask 2 (`truth/`)&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The corpus data have been automatically lemmatized and part-of-speech tagged, and have been partially corrected by hand. For homonyms, the lemmas are followed by the &amp;#39;\#&amp;#39; symbol and the number of the homonym according to the Lewis-Short dictionary of Latin when this number is greater than 1. For example, the lemma &amp;#39;dico&amp;#39; corresponds to the first homonym in the Lewis-Short dictionary and &amp;#39;dico\#2&amp;#39; corresponds to the second homonym, cf. Lewis-Short dictionary.&lt;/p&gt;

&lt;p&gt;__Corpus 1__&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;based on: &lt;a href="http://hdl.handle.net/11372/LRT-3170"&gt;LatinISE&lt;/a&gt;&amp;nbsp;(McGillivray and Kilgarriff 2013), &lt;a href="https://app.sketchengine.eu/#dashboard?corpname=preloaded/latinise_4"&gt;version on Sketch Engine&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;language: Latin&lt;/li&gt;
	&lt;li&gt;time covered: from the beginning of the second century before Christ (BC) to the end of the first century BC&lt;/li&gt;
	&lt;li&gt;size: ~1.7 million tokens&lt;/li&gt;
	&lt;li&gt;format: lemmatized, sentence length &amp;gt;= 2, no punctuation, sentences randomly shuffled&lt;/li&gt;
	&lt;li&gt;encoding: UTF-8&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;__Corpus 2__&lt;/p&gt;

&lt;ul&gt;
	&lt;li&gt;based on: &lt;a href="http://hdl.handle.net/11372/LRT-3170"&gt;LatinISE&lt;/a&gt;&amp;nbsp;(McGillivray and Kilgarriff 2013) , &lt;a href="https://app.sketchengine.eu/#dashboard?corpname=preloaded/latinise_4"&gt;version on Sketch Engine&lt;/a&gt;&lt;/li&gt;
	&lt;li&gt;language: Latin&lt;/li&gt;
	&lt;li&gt;time covered: from the beginning of the first century after Christ (AD) to the end of the twenty-first century AD&lt;/li&gt;
	&lt;li&gt;size: ~9.4 million tokens&lt;/li&gt;
	&lt;li&gt;format: lemmatized, sentence length &amp;gt;= 2, no punctuation, sentences randomly shuffled&lt;/li&gt;
	&lt;li&gt;encoding: UTF-8&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Find more information on the data in the papers referenced below.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;References&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky and Nina Tahmasebi &lt;a href="https://competitions.codalab.org/competitions/20948"&gt;SemEval 2020 Task 1: Unsupervised Lexical Semantic Change Detection&lt;/a&gt;. To appear in SemEval@COLING2020.&lt;/p&gt;

&lt;p&gt;McGillivray, B. and Kilgarriff, A. (2013). &lt;a href="https://www.sketchengine.co.uk/wp-content/uploads/2015/05/Latin_historical_corpus_2013.pdf"&gt;Tools for historical corpus research, and a corpus of Latin&lt;/a&gt;. In Paul Bennett, Martin Durrell, Silke Scheible, Richard J. Whitt (eds.), New Methods in Historical Corpus Linguistics, T&amp;uuml;bingen: Narr.&lt;br&gt;
&amp;nbsp;&lt;/p&gt;</subfield>
  </datafield>
  <datafield tag="773" ind1=" " ind2=" ">
    <subfield code="n">doi</subfield>
    <subfield code="i">isVersionOf</subfield>
    <subfield code="a">10.5281/zenodo.3674098</subfield>
  </datafield>
  <datafield tag="024" ind1=" " ind2=" ">
    <subfield code="a">10.5281/zenodo.3734089</subfield>
    <subfield code="2">doi</subfield>
  </datafield>
  <datafield tag="980" ind1=" " ind2=" ">
    <subfield code="a">dataset</subfield>
  </datafield>
</record>
737
615
views
downloads
All versions This version
Views 737131
Downloads 61563
Data volume 18.2 GB1.8 GB
Unique views 619114
Unique downloads 54157

Share

Cite as