SocialDisNER corpus: gold standard annotations for detection of disease mentions in Spanish tweets

Gold Standard annotations for SocialDisNER (SMM4H 2022 – Task 10) shared task.

Introduction:
The SocialDisNER corpus of the SMM4H 2022 – Task 10 task will focus on the recognition of disease mentions in tweets written in Spanish after selecting primarily first-hand experience of diseases and other health-relevant content (from patient associations, professional healthcare institutions, and through followers of patient association accounts of a diversity of pathologies including rare diseases, mental health, cancer, etc..).

The corpus was manually annotated by medical experts following the SMM4H-SocialDisNER guidelines. These guidelines were adapted from previous efforts used to annotate patient clinical records and medical literature. It covers rules for annotating mentions of diseases in health-related tweets in Spanish,

The current training set consists of 2415 tweets written in Spanish, the annotated validation set and the unannotated test set will be published shortly. The structure of the dataset is: 

• socialdisner.zip:
  • train-valid-txt-files:  folder with training and validation text files. One text file per tweet, he file name corresponds to the tweet id.. One sub-directory per corpus split (train and valid). Validation tweets have not yet been included.
  • mentions.tsv: This file contains the manually annotated disease mentions. The file has the following fields:
    • tweets_id: This is the id of the tweet, using Twitter API you can query the content of the tweet.
    • Begin: This is the position in the tweet where the annotation was found.
    • End: This is the position of the last character of the annotation in the tweet.
    • Type: This is the type of entity found, in our case "ENFERMEDAD".
    • Extraction: This is the literal extraction, in other words, the fragment of text which refers to the annotation. 

For further information, please visit https://temu.bsc.es/socialdisner/

Do not share the data with other individuals/teams without permission from the task organizer. Tweets IDs are the primary source of information. Tweet texts are provided as support material. By downloading this resource, you agree to the Twitter Terms of Service, Privacy Policy, Developer Agreement, and Developer Policy.