Authors
Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky, and Nina Tahmasebi
Description
This data collection contains the post-evaluation data for SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection:
starting_kit/
),test_data_truth/
),scoring_program/
),results/rankings_teams.csv
),results/submissions/
),results/submissions_results.csv
),plots/
) displaying the results:
per_target/
we provide the gold change scores and the normalized prediction error of target words plotted against their frequency and polysemy statistics,per_team/
we provide the model predictions from the best submission per team (per subtask) plotted against frequency/polysemy statistics and performance on gold data (gray lines give the correlation with the respective variable in the gold data); we also provide plots of visualizing the teams' prediction similarities.Some remarks:
results/
and team names in the paper. The paper contains a key to match old names with new names.Test Data for SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection can be found using the links below:
Please find more information on the provided data in the paper referenced below.
Reference
Dominik Schlechtweg, Barbara McGillivray, Simon Hengchen, Haim Dubossarsky and Nina Tahmasebi. 2020. SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection. SemEval@COLING2020.
The resources are freely available for education, research and other non-commercial purposes.
@inproceedings{schlechtweg2020semeval,
title = "{S}em{E}val-2020 {T}ask 1: {U}nsupervised {L}exical {S}emantic {C}hange {D}etection",
author = "Schlechtweg, Dominik and McGillivray, Barbara and Hengchen, Simon and Dubossarsky, Haim and Tahmasebi, Nina",
booktitle = "To appear in Proceedings of the 14th International Workshop on Semantic Evaluation",
year = "2020",
address = "Barcelona, Spain",
publisher = "Association for Computational Linguistics"}