Published February 27, 2025 | Version v1
Dataset Open

The chat records of diagnoses for China's first batch of rare disease catalog by ChatGPT-4o and the four LLMs

  • 1. Department of Prenatal Diagnosis, Beijing Obstetrics and Gynecology Hospital, Capital Medical University. Beijing Maternal and Child Health Care Hospital

Description

This study aimed to evaluate the diagnostic accuracy of ChatGPT-4o and 4 open-source LLMs (qwen2.5:7b, Llama3.1:8b, qwen2.5:72b, and Llama3.1:70b) for rare diseases, assesses the language effect on diagnostic performance, and explore retrieval augmented generation (RAG) and chain-of-thought (CoT) reasoning.

This supplementary material includes the first rare disease catalog of ChatGPT-4o in China and all diagnostic chat records for four LLMs in this study. This file contains a collection of 11 chat content. The LLM diagnostic order of cases can be found in Appendix 2 of Multimedia.

Files

Files (2.2 MB)

Name Size Download all
md5:96b6aaa8826d45bbe370d5dbeee40bed
151.6 kB Download
md5:5386804002577a476505ffd84e3d0970
77.5 kB Download
md5:58c82797775f672c07c43ffdbbb9d549
190.9 kB Download
md5:10d6558d2b0d7dea00d262c10587836f
166.9 kB Download
md5:16a8dd5fbda7c2c74684fb7e5e5fbb80
176.3 kB Download
md5:0c374cbe233fbcf88ea529bfc666198a
164.6 kB Download
md5:50def356206c500324b5ca968e74e643
175.1 kB Download
md5:79485a73346fac73338d79241706ae45
228.3 kB Download
md5:61579c1da4e2ad1b79e8f4d604d2fc70
232.9 kB Download
md5:dd567b7fc7e5af616ef03909244b6692
176.0 kB Download
md5:933508a82597bd06b3c62ae6134de672
190.9 kB Download
md5:a6cb50485d2b4b88baca0bb25598d897
232.2 kB Download