Published June 6, 2025
| Version v3
Dataset
Open
4917 Phenopackets and Prompts in 10 Languages for LLM Evaluation, with results for GPT-4o and Meditron3-70B
Authors/Creators
-
1.
Berlin Institute of Health at Charité - Universitätsmedizin Berlin
-
2.
Lawrence Berkeley National Laboratory
- 3. The Jackson Laboratory for Genomic Medicine
Description
Collection of 4917 GA4GH Phenopackets and of prompts generated from them in 10 languages:
English, Chinese, Czech, Dutch, French, German, Italian, Japanese, Spanish, and Turkish.
Used in project about multilingual capability of LLMs (GPT-4o and Meditron3-70B) in rare genetic disease diagnostics. Also contains our results of the comparison of the 10 languages for each of the models. Paper published in eBioMedicine here.
Phenopacket Store version 0.1.19. Phenopackets found here are the subset for which all HPO terms are known in the 10 languages, using HPO version 2024-12-12
Files
4917promptsX10langs.zip
Additional details
Related works
- Is supplemented by
- Dataset: 10.5281/zenodo.15065293 (DOI)