MultiCaRe: An open-source clinical case dataset for medical image classification and multimodal AI applications

The dataset contains multi-modal data from over 85,000 open access and de-identified case reports, including metadata, clinical cases, image captions and more than 160,000 images. Images and clinical cases belong to different medical specialties, such as oncology, cardiology, surgery and pathology. The structure of the dataset allows to easily map images with their corresponding article metadata, clinical case, captions and image labels. Details of the data structure can be found in the file data_dictionary.csv.

More than 110,000 patients and 300,000 medical doctors and researchers were involved in the creation of the articles included in this dataset. The citation data of each article can be found in the metadata.parquet file.

Refer to the examples showcased in this GitHub repository to understand how to optimize the use of this dataset.