Conference paper Open Access

A Dataset for Multi-lingual Epidemiological Event Extraction

Mutuvi, Stephen; Doucet, Antoine; Lejeune, Gael; Odeo, Moses

This paper proposes a corpus for development and evaluation of tools and techniques for identifying emerging infectious disease threats in online news text. The corpus can not only be used for Information Extraction, but also for other Natural Language Processing tasks such as text classification. We make use of articles published on the Program for Monitoring Emerging Diseases (PROMED) platform, which provides current information about outbreaks of infectious disease globally. Among the key pieces of information present in the articles is the Uniform Resource Locator (URL) to the online news sources where the outbreaks were originally reported. We detail the procedure followed to build the dataset, which include leveraging the source URLs to retrieve the news reports and subsequently pre-processing the retrieved documents. We also report on experimental results of event extraction on the dataset using the Data Analysis for Information Extraction in any Language(DANIEL) system. DANIEL is a multilingual news surveillance system that leverages unique attributes associated with news reporting repetition and saliency, to extract events. The system has a wide geographical and language coverage, including low-resource languages. In addition, we compare different classification approaches in terms of their ability to differentiate between epidemic related and non-related news articles that constitute the corpus.

Files (132.6 kB)
Name Size
A_Dataset_for_Epidemiological_Event_Extraction__CORRECTIONS(1).pdf
md5:a2bb68b2d8b7ddf9ae947caa32449704
132.6 kB Download
69
51
views
downloads
All versions This version
Views 6945
Downloads 5125
Data volume 7.2 MB3.3 MB
Unique views 6041
Unique downloads 4523

Share

Cite as