DisTEMIST corpus: detection and normalization of disease mentions in spanish clinical cases

DisTEMIST corpus

DISTEMIST-entities: complete training set (750 clinical cases)

DISTEMIST-linking: part 1 of the training set (209 clinical cases)

DISTEMIST-linking: part 2 of the training set (375 clinical cases)

Introduction

The DisTEMIST corpus is a collection of 1000 clinical cases with disease annotations linked with Snomed-CT concepts. All documents are released in the context of the BioASQ DisTEMIST track for CLEF 2022. For more information about the track and its schedule, please visit the website.

File structure:

The DisTEMIST corpus has been randomly divided into a training set, containing 750 clinical cases, and a test set (584 in the case of subtrack2), consisting of 250 additional cases. Participants must train their systems using the train set and submit predictions for the test set, on which they will be evaluated.  The file structure of the corpus is as follows:

• train_set:
  • text_files: Folder with plain text files of the clinical cases  
  • subtrack1_entities: It contains annotations in a tab-separated file (TSV) with the following columns:
    • filename: document name
    • mark: identifier mention id
    • label: mentions type (ENFERMEDAD)
    • off0: starting position of the mention in the document
    • off1: ending position of the mention in the document
    • span:  text span
  • subtrack2_linking: It contains annotations in a tab-separated file (TSV) with the following columns:
    • filename: document name
    • mark: identifier mention id
    • label: mentions type (ENFERMEDAD)
    • off0: starting position of the mention in the document
    • off1: ending position of the mention in the document
    • span:  text span
    • codes: List of Snomed-CT concept codes linked to the mention. If there is more than one code associated with a mention, they will be concatenated by the symbol “+”.
    • semantic relation: the relationship between the assigned code and the mention. It can be EXACT, when the code corresponds exactly with the mention, or NARROW, when the mention corresponds to a narrower concept than the Snomed-CT code. For instance, the concept “Chorioretinal lacunae” does not exist in Snomed-CT. Then, it is normalized to the Snomed-CT ID 302893000 (“Chorioretinal disorder”).

• test_set: The 250 clinical cases that will be used to evaluate the systems will be published in accordance with the schedule of the task.

Resources 

• Web
• Evaluation Library
• DISTEMIST gazetteer
• DISTEMIST guidelines
• More resources soon