Published January 31, 2018 | Version v1

Multilingual Semantic Relatedness using lightweight machine translation

  • 1. Insight Centre for Data Analytics, National University of Ireland, Galway
  • 2. Department of Computer Science, Maynooth University
  • 3. Department of Computer Science and Mathematics, University of Passau
  • 4. School of Computer Science, University of Manchester

Description

Distributional semantic models are strongly dependent on the size and the quality of the reference corpora, which embeds the commonsense knowledge necessary to build comprehensive models. While high-quality texts containing large-scale commonsense information are present in English, such as Wikipedia, other languages may lack sufficient textual support to build distributional models. This paper proposes using the combination of a lightweight (sloppy) machine translation model and an English Distributional Semantic Model (DSM) to provide higher quality word vectors for languages other than English. Results show that the lightweight MT model introduces significant improvements when compared to language-specific distributional models. Additionally, the lightweight MT outperforms more complex MT methods for the task of word-pair translation.

Files

2018-Accepted-ICSC-MultiLingual.pdf

Files (463.2 kB)

Name Size
md5:2ff068318a232cd5e50aa9b2930fae4c
463.2 kB Preview Download

Additional details

Funding

European Commission
SSIX - Social Sentiment analysis financial IndeXes 645425