MultiClinSum Shared Task Dataset

MultiClinSum is a shared task about the automatic summarization of clinical case reports in English, Spanish, French and Portuguese held as part of the BioASQ workshop at CLEF 2025. The task relies on a corpus of manually selected full clinical case reports and their corresponding clinical case report summaries derived from case report publications written in the previously mentioned languages. In addition, participants are allowed to use any other data source available online as long as they report it.

This repository includes the available datasets for the multilingual clinical summarization task. Each dataset contains pairs of full-text documents and their corresponding summaries.

• multiclinsum_gs_train_en: Gold-standard training dataset in English, containing 592 full-text and summary pairs.
• multiclinsum_gs_train_es: Gold-standard training dataset in Spanish, containing 592 full-text and summary pairs.
• multiclinsum_gs_train_fr: Gold-standard training dataset in French, containing 592 full-text and summary pairs.
• multiclinsum_gs_train_pt: Gold-standard training dataset in Portuguese, containing 592 full-text and summary pairs.
• multiclinsum_large-scale_train_en: Large scale training dataset in English, containing 25.902 full-text and summary pairs.
• multiclinsum_large-scale_train_es: Large scale training dataset in Spanish, containing 25.902 full-text and summary pairs.
• multiclinsum_large-scale_train_fr: Large scale training dataset in French, containing 25.902 full-text and summary pairs.
• multiclinsum_large-scale_train_pt: Large scale training dataset in Portuguese, containing 25.902 full-text and summary pairs.
• multiclinsum_test_en: Test dataset in English, containing 3.396 full-text cases.
• multiclinsum_test_es: Test dataset in Spanish, containing 3.406 full-text cases.
• multiclinsum_test_fr: Test dataset in French, containing 3.469 full-text cases.
• multiclinsum_test_pt: Test dataset in Portuguese, containing 3.442 full-text cases.

For each dataset, full-texts and summaries are organised in separate folders containing .txt files encoded in UTF-8. For a given language, files have nearly identical filenames, with summaries marked by the _sum suffix.

Resources:

- MultiClinSum website

- BioASQ website

License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Contact

If you have any questions or suggestions, please contact us at:

• Miguel Rodríguez Ortega (<miguel [dot] rod [dot] bsc [at] gmail [dot] com>)
• Eduard Rodríguez López (<edu4bsc [at] gmail [dot] com>)
• Salvador Lima-López (<salvador [dot] limalopez [at] gmail [dot] com>)
• Martin Krallinger (<krallinger [dot] martin [at] gmail [dot] com>)

Additional resources and corpora

If you are interested in MultiClinSum, you might want to check out these corpora and resources:

• DisTEMIST (Corpus of disease mentions and normalization to SNOMED CT)
• MedProcNER (Corpus of clinical procedure mentions and normalization to SNOMED CT)
• SympTEMIST (Corpus of clinical findings and normalization to SNOMED CT)
• DrugTEMIST (Corpus of medication mentions)
• CardioCCC (Corpus of diseases and medication mentions in cardiology texts)
• PharmaCoNER (Corpus of medications, drugs, chemical substances, genes, proteins and vaccine mentions and normalization)
• MEDDOPROF (Corpus of mentions of professions, occupations and working status and normalization)
• MEDDOPLACE (Corpus of mentions of place-related entity mentions, including departments, nationalities or patient movements etc.. and normalization)
• MEDDOCAN (Corpus of mentions of Personal Health Identifiers (PHI))
• CANTEMIST (Corpus of cancer tumor morphology mentions and normalization)
• CodiESP (Corpus of clinical case reportes with assigned clinical codes from ICD10, Spanish version)
• LivingNER (Corpus of mentions of species, including human/family members, pathogens, food, etc.. and normalization to NCBI Taxonomy)
• SPACCC-POS (Corpus of clinical case reports in Spanish annotated with POS-tags)
• SPACCC-TOKEN (Corpus of clinical case reports in Spanish annotated with token-tags (word mention boundaries))
• SPACCC-SPLIT (Corpus of clinical case reports in Spanish annotated with sentence boundary-tags)
• MESINESP-2 (Corpus of manually indexed records with DeCS /MeSH terms comprising scientific literature abstracts, clinical trials, and patent abstracts)