There is a newer version of this record available.

Dataset Open Access

# MESINESP2 Corpora: Annotated data for medical semantic indexing in Spanish

Gasco, Luis; Krallinger, Martin

Annotated corpora for MESINESP2 shared-task (Spanish BioASQ track, see https://temu.bsc.es/mesinesp2). BioASQ 2021 will be held at CLEF 2021 (scheduled in Bucharest, Romania in September) http://clef2021.clef-initiative.eu/

Introduction:
These corpora contain the data for each of the sub-tracks of MESINESP2 shared-task:

• Track 1- Medical indexing:
• Training set: It contains all spanish records from LILACS and IBECS databases at the Virtual Health Library (VHL) with non-empty abstract written in Spanish. We have filtered out empty abstracts and non-Spanish abstracts.  We have built the training dataset with the data crawled on 01/29/2021. This means that the data is a snapshot of that moment and that may change over time since LILACS and IBECS usually add or modify indexes after the first inclusion in the database. We distribute two different datasets:
• Articles training set: This corpus contains the set of 237574 Spanish scientific papers in VHL that have at least one DeCS code assigned to them.
• Full training set: This corpus contains the whole set of 249474 Spanish documents from VHL that have at leas one DeCS code assigned to them.
• Development set: We provide a development set manually indexed by expert annotators. This dataset includes 1065 articles annotated with DeCS by three expert indexers in this controlled vocabulary. The articles were initially indexed by 7 annotators, after analyzing the Inter-Annotator Agreement among their annotations we decided to select the 3 best ones, considering their annotations the valid ones to build the test set. From those 1065 records:
• 213 articles were annotated by more than one annotator. We have selected de union between annotations.
• 852 articles were annotated by only one of the three selected annotators with better performance.
• Test set: To be published
• Track 2- Clinical trials:
• Training set: The training dataset contains records from Registro Español de Estudios Clínicos (REEC). REEC doesn't provide documents with the structure title/abstract needed in BioASQ, for that reason we have built artificial abstracts based on the content available in the data crawled using the REEC API. Clinical trials are not indexed with DeCS terminology, we have used as training data a set of 3592 clinical trials that were automatically annotated in the first edition of MESINESP and that were published as a Silver Standard outcome. Because the performance of the models used by the participants was variable, we have only selected predictions from runs with a MiF higher than 0.30, which corresponds with the submission of the best three teams. We have selected the union of all codes assigned by those team.
• Development set: We provide a development set manually indexed by expert annotators. This dataset includes 147 clinical trials annotated with DeCS by seven expert indexers in this controlled vocabulary.
• Track 3- Patents: To be published

Files structure:

MESINESP2_corpus.zip contains the corpora generated for the shared task. Content:

• Subtrack1:
• Train
• training_set_track1_all.json: Full training set for sub-track 1.
• training_set_track1_only_articles.json: Articles training set for sub-track 1.
• Test
• development_set_subtrack1.json: Manually annotated development set for sub-track 1.
• Subtrack2:
• Train
• training_set_subtrack2.json: Training set for sub-track 2.
• Test
• development_set_subtrack2.json: Manually annotated development set for sub-track 2.
• Subtrack3: This folder is empty. Data for sub-track 3 will be published soon.

DeCS2020.tsv contains a DeCS table with the following structure:

• DeCS code
• Preferred descriptor (the preferred label in the Latin Spanish Decs 2020 set)
• List of synonyms (the descriptors and synonyms from Latin Spanish DeCS 2020, separate by pipes)

DeCS2020.obo contains the *.obo file with the hierarchical relationships between DeCS descriptors.

For further information, please visit https://temu.bsc.es/mesinesp2/ or email us at encargo-pln-life@bsc.es

Funded by the Plan de Impulso de las Tecnologías del Lenguaje (Plan TL).
Files (284.6 MB)
Name Size
DeCS2020.obo
md5:26c8b714485d5ed657c0919bb19d287c
21.4 MB
DeCS2020.tsv
md5:9fc4443dba46209048cb8d1fb2e215fa
8.1 MB
MESINESP2_corpus.zip.zip
md5:babe1f7bd3044eb8d6792e380022d69e
255.2 MB
1,890
422
views
All versions This version
Views 1,890130
Data volume 33.7 GB4.1 GB
Unique views 1,397107