Dataset Open Access

Adapting Phrase-based Machine Translation to Normalise Medical Terms in Social Media Messages

Limsopatham, Nut; Collier, Nigel

Data and supplementary information for the paper entitled "Adapting Phrase-based Machine Translation to Normalise Medical Terms in Social Media Messages" to be published at EMNLP 2015: Conference on Empirical Methods in Natural Language Processing — September 17–21, 2015 — Lisboa, Portugal.

ABSTRACT: Previous studies have shown that health reports in social media, such as DailyStrength and Twitter, have potential for monitoring health conditions (e.g. adverse drug reactions, infectious diseases) in particular communities. However, in order for a machine to understand and make inferences on these health conditions, the ability to recognise when laymen's terms refer to a particular medical concept (i.e. text normalisation) is required. To achieve this, we propose to adapt an existing phrase-based machine translation (MT) technique and a vector representation of words to map between a social media phrase and a medical concept. We evaluate our proposed approach using a collection of phrases from tweets related to adverse drug reactions. Our experimental results show that the combination of a phrase-based MT technique and the similarity between word vector representations outperforms the baselines that apply only either of them by up to 55%.

Files (1.7 GB)
Name Size
EMNLP_gold_standard.txt
md5:673803dbdef98794112104861e099d94
11.3 kB Download
EMNLP_supplement.zip
md5:de242f0764e5c875bc671300d1da1abf
255.4 kB Download
word-vector-examples.zip
md5:e5e320a3e3e112473243dfed1351717a
1.7 GB Download
71
26
views
downloads
All versions This version
Views 7171
Downloads 2626
Data volume 19.2 GB19.2 GB
Unique views 6767
Unique downloads 1515

Share

Cite as