Published September 20, 2026 | Version 1

Healthcare AI Trust Calibration Scenario Bank (HAI-TRUST): Role-Specific Experimental Vignettes for Studying Calibrated Reliance Under Incomplete Information

  • 1. ROR icon University of Wollongong in Dubai
  • 2. ENAI WG Centre for Academic Integrity in the UAE
  • 3. European Network for Academic Integrity
  • 4. Dakar American University of Science and Technology
  • 5. AI and Data Science (AID) Lab
  • 6. PRISM AI Safety Research Fellowship
  • 7. Turing

Contributors

Related person:

  • 1. Independent AI Safety Researcher

Description

HAI-TRUST (Healthcare AI Trust Calibration Scenario Bank) is a structured research stimulus and instrument bank for studying calibrated reliance on healthcare AI under incomplete information. It contains five matched fictional healthcare contexts adapted across three decision perspectives -public/patient-facing, healthcare/clinical, and AI/computing/developer - yielding 15 role-specific scenarios. Each scenario is represented under six controlled AI-output conditions: answer only, explanation, simulated confidence, uncertainty, warning/verification, and a combined output.

The five contexts cover exertional chest tightness and fatigue, sudden severe headache, AI-assisted insulin dose adjustment, postoperative wound photo triage, and medication safety for a new over-the-counter pain medicine. Researcher-facing reference conditions and action-alignment coding are included to support experimental use.

Version 1.0 incorporates two initial independent expert reviews and targeted Round 2 domain re-review. Revisions included cross-role harmonisation, clarification of action versus reliance coding, refinement of the simulated 80% confidence cue, scenario-specific clinical amendments, and clearer separation of patient-facing AI outputs from developer/governance decisions. A dedicated surgery/wound-care specialist response was not obtained in Round 2 and is documented as a validation limitation.

HAI-TRUST consists of fictional research stimuli. It is not a clinical dataset, medical advice, a diagnostic system, or a clinically validated decision-support resource. The empirical study associated with the project fielded v0.9; v1.0 is the post-review repository release and should not be described as the exact stimulus version used for previously collected data.

Files

1 README.md

Files (254.2 kB)

Name Size
md5:172cacda11cd79f81ed10fdabba8aeb4
4.8 kB Preview Download
md5:8ffccfa181b3fa8ef1d532b0c60fb699
1.3 kB Preview Download
md5:a7d54a6088040fdd31b9785ceb40399e
702 Bytes Preview Download
md5:9f3fc0ca261e75373a9fa90061fa2750
3.1 kB Preview Download
md5:0748bb54aae0e43977dfae50226f215d
794 Bytes Preview Download
md5:bc083eb6d11e5f5638b70af73abe1da2
48.5 kB Download
md5:abde3e213120b0496f5d6ec483182ae6
30.6 kB Preview Download
md5:a1d961bcc389511794a8231710e66d57
135.8 kB Preview Download
md5:87edc0f67ea88deb3a6e968995760a90
26.2 kB Preview Download
md5:eae9991825a116c7dc7c06a8c0336a4c
2.4 kB Preview Download