Published June 3, 2026 | Version v1
Dataset Open

Cross-lingual consistency of large language models in ICD-11 coding: benchmark code and data (six languages, six models)

Authors/Creators

  • 1. Faculty of Nursing, Shumei University

Description

Reproducible benchmark accompanying the manuscript "Cross-lingual consistency of large language models in ICD-11 coding: a six-language benchmark." Includes the scoring and figure-generation code, the per-call results log (results_prod.csv) for six LLMs across six languages, and an item manifest (entities_manifest.json) listing the 300 sampled ICD-11 entities as code, official ICD-API URL, and English title. To respect the ICD-11 license (CC BY-ND 3.0 IGO), the WHO definition text is not redistributed; the official multilingual titles and definitions can be retrieved from the WHO ICD-API using each entity's URL, or by re-running the pipeline with the fixed seed. Measurement date: June 2026; ICD-11 release 2025-01.

Files

bootstrap_ci.json

Files (4.1 MB)

Name Size Download all
md5:cbe022d0b4ada7eeddd790e3feee0528
2.5 kB Download
md5:b1d2b38beefc9f3542eb189ffb442f7f
834 Bytes Preview Download
md5:4067c69d5977469e37451d3522878aa9
606 Bytes Preview Download
md5:dfc0e3c123a45ff0c5a56cf1766e5efb
303 Bytes Preview Download
md5:67ac50213a84d93210fae23e6b9c94bc
46.8 kB Preview Download
md5:b4c1950f0c0884a8d5dbb20598ae0b52
157.3 kB Preview Download
md5:805d2da2d672ecf83cd9c97706afac04
214.9 kB Preview Download
md5:154b403fc8058cfab67cca1bf6b02462
111.3 kB Preview Download
md5:81f31f9a541439d70d0586526c2aed0c
77.1 kB Preview Download
md5:cbc177db3d73f6e46adffa2fa638556c
255.3 kB Preview Download
md5:dc711bdce0f9be03b8c88e7dab62dc40
231.2 kB Preview Download
md5:39348e1241a832b39e67fa90f220edf6
339.8 kB Preview Download
md5:1e6b8336fa549e8bc258f370205a8906
428 Bytes Preview Download
md5:a6aebbac9b0be417a5ced315abbbc761
1.8 kB Download
md5:5711989005b313175914f3cbd7b85044
7.6 kB Download
md5:410a785389cdd2200e8308f9f4239992
8.6 kB Download
md5:5744b72947a9629b14ef7509d077f16a
1.7 kB Preview Download
md5:7cdce31a4c90996114cf8d9df4341391
26.5 kB Download
md5:80c2cf0ce6530bbbad6577f0db6019e9
26.8 kB Download
md5:a101f0627db160437d31dd243264c3b8
176.9 kB Preview Download
md5:09f0f930779898ff86ca1dbddf98cca4
7.4 kB Preview Download
md5:5c4635c0fe66f213f9eec444d2be36e1
6.7 kB Download
md5:85dd97a663f5bda9ea6f438d688627d8
10.8 kB Download
md5:9c1eed6047652f765ba39cb056d8d060
2.4 MB Preview Download
md5:35f4b400a5af48747ad766bea6302b07
392 Bytes Preview Download