The Refusal Stack
Description
Medical artificial intelligence is approaching a regulatory transition in which the burden of proof shifts from system performance to system accountability. The European Union Artificial Intelligence Act, the WHO guidance on large multi-modal models for health, and the United States Food and Drug Administration's frameworks for Software as a Medical Device each create or reinforce architectural expectations that benchmark-driven development does not address. This paper proposes that the operational unit of safety engineering for medical AI is the refusal — the system's documented, audited decision not to answer under specified conditions — and offers a five-class taxonomy for organising it. The paper describes one refusal class in detail, identifies architectural requirements for source-grounding, audit-trail immutability, and permission-first ingestion, and proposes a six-point technical due-diligence procedure. Implementations specific to one provider are not described.
Files
the-refusal-stack-preprint.pdf
Files
(482.9 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:6b13659ab6ae71ed77aec11de248362c
|
482.9 kB | Preview Download |
Additional details
Additional titles
- Subtitle (English)
- Engineering Medical AI for Adversarial Audit
Related works
- Is supplement to
- Publication: 10.5281/zenodo.20258141 (DOI)
- Is supplemented by
- Publication: 10.5281/zenodo.20491302 (DOI)
- Publication: 10.5281/zenodo.20490998 (DOI)
References
- Chung P, Swaminathan A, Goodell AJ, Kim Y, et al. Verifying facts in patient care documents generated by large language models using electronic health records. NEJM AI. Published online 24 December 2025. doi:10.1056/AIdbp2500418.
- Wong A, Otles E, Donnelly JP, Krumm A, McCullough J, DeTroyer-Cooley O, Pestrue J, Phillips M, Konye J, Penoza C, Ghous M, Singh K. External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Intern Med. 2021;181(8):1065–1070. doi:10.1001/jamainternmed.2021.2626.
- World Health Organization. Ethics and governance of artificial intelligence for health: Guidance on large multi-modal models. Geneva: WHO; 2024–2025. ISBN 9789240084759.
- Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence (Artificial Intelligence Act). Articles 9, 10, 11, 12, 13, 14, 15, 50, 113; Annexes I and III. General application: 2 August 2026 per Article 113.
- Schneier B, Kelsey J. Cryptographic support for secure logs on untrusted machines. In: Proceedings of the 7th USENIX Security Symposium, San Antonio, TX; 26–29 January 1998; pp. 53–62.
- Stanford Center for Research on Foundation Models. MedHELM: Holistic Evaluation of Language Models for Medical Tasks. Stanford CRFM; arXiv preprint, 2025; peer-reviewed publication in Nature Medicine, 2026. Benchmark and methodology available via the HELM project pages.