Published November 27, 2023 | Version 3
Dataset Open

RheumaMIR

Creators

  • 1. Grupo de Patología Musculoesquelética. Hospital Clínico San Carlos. Instituto de Investigación Sanitaria San Carlos (IdISSC), Prof. Martin Lagos s/n, Madrid, 28040, Spain
  • 2. Reumatología. Hospital Universitario la Paz-IdiPaz, Paseo de la Castellana, 261, Madrid, 28046, Spain
  • 3. Medicina Interna. Hospital Universitario del Henares, Avenida de Marie Curie, 0, Madrid, 28822, Spain

Contributors

  • 1. Grupo de Patología Musculoesquelética. Hospital Clínico San Carlos. Instituto de Investigación Sanitaria San Carlos (IdISSC), Prof. Martin Lagos s/n, Madrid, 28040, Spain
  • 2. Reumatología. Hospital Universitario la Paz-IdiPaz, Paseo de la Castellana, 261, Madrid, 28046, Spain
  • 3. Medicina Interna. Hospital Universitario del Henares, Avenida de Marie Curie, 0, Madrid, 28822, Spain

Description

This dataset accompanies the research paper entitled: 

Harnessing ChatGPT and GPT-4 for Evaluating the Rheumatology Questions of the Spanish Access Exam to Specialized Medical Training.

Alfredo Madrid-García, Zulema Rosales-Rosado, Dalifer Dayanira Freites-Núñez, Inés Pérez-Sancristobal, Esperanza Pato-Cour, Chamaida Plasencia-Rodríguez, Luis Cabeza-Osorio, Lydia Abasolo Alcazar, Leticia Leon Mateos, Benjamín Fernández-Gutiérrez, Luis Rodríguez-Rodríguez

medRxiv 2023.07.21.23292821; doi: https://doi.org/10.1101/2023.07.21.23292821

The dataset contains 145 rheumatology-related questions extracted from the Spanish MIR exams held between the academic years 2009-2010 to 2022-2023. The questions are evaluated by ChatGPT, GPT-4, BARD and CLAUDE. Six rheumatologists assess the clinical reasoning of ChatGPT and GPT-4.

A more detailed description of the dataset can be found in "Dataset Description" Sheet

Files

Files (594.8 kB)

Name Size Download all
md5:e96b7e721077dda4409c9c984b2e6a40
594.8 kB Download

Additional details

References

  • Harnessing ChatGPT and GPT-4 for Evaluating the Rheumatology Questions of the Spanish Access Exam to Specialized Medical Training. Alfredo Madrid-García, Zulema Rosales-Rosado, Dalifer Dayanira Freites-Núñez, Inés Pérez-Sancristobal, Esperanza Pato-Cour, Chamaida Plasencia-Rodríguez, Luis Cabeza-Osorio, Lydia Abasolo Alcazar, Leticia Leon Mateos, Benjamín Fernández-Gutiérrez, Luis Rodríguez-Rodríguez medRxiv 2023.07.21.23292821; doi: https://doi.org/10.1101/2023.07.21.23292821