Published August 6, 2026 | Version Extended version, inclusive of supplementary materials, of the paper accepted at the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026).

From Oracles to Productive Friction: Designing for Meaningful Human Oversight in Clinical AI.

  • 1. Department of Computer Science, Lancaster University, UK
  • 2. Department of Management, Economics and Industrial Engineering, Politecnico di Milano, Italy
  • 3. ROR icon Vrije Universiteit Amsterdam
  • 4. Institute of integrated diagnostics of Southern Switzerland, Ente Ospedaliero Cantonale (EOC), Switzerland
  • 5. ROR icon University of Applied Sciences and Arts of Southern Switzerland
  • 6. ROR icon Dalle Molle Institute for Artificial Intelligence Research

Description

We propose productive friction as a design principle for clinical AI: the deliberate, graded introduction of interaction cost when accepting machine recommendations, calibrated to case uncertainty so that analytical reasoning is activated without disrupting workflow. We ground this principle in a mixed-method study with eleven practising radiologists interacting with two contrasting prototypes, an oracular system delivering a single diagnosis and an evaluative system presenting multiple differentials with reference exemplars. Results reveal a consistent preference for evaluative support in complex cases, where it enhances diagnostic reasoning, confidence, and reflective engagement, while oracular outputs were favoured for routine tasks. Radiologists described evaluative support as ``accompanying'' their thinking, preserving professional agency and offering pedagogical value. We argue that productive friction carries direct ethical significance: when agreeing with an AI recommendation requires less effort than disagreeing, the clinician's role risks becoming procedural rather than a genuine locus of judgement. We operationalise this principle along four dimensions, temporal delay, option cardinality, evidence depth, and commitment structure, and translate it into implementable design mechanisms for adaptive clinical AI.

Files

ProductiveFriction_AIES_Extended.pdf

Files (477.9 kB)

Name Size
md5:686c4ad66e07e6a37e54b2e8e97a9148
477.9 kB Preview Download

Additional details

Funding

Federal Commission for Scholarships for Foreign Students
Swiss Government Excellence Scholarship 2024.0002
Scuola Universitaria Professionale della Svizzera Italiana
Best4EthicalAI
Swiss Confederation
Movetia
European Union, European Education and Culture Executive Agency
EUonAIR Centre of Excellence in Responsible AI and Education

Dates

Accepted
2026-08-06
Extended version, inclusive of supplementary materials, of the paper accepted at the 9th AAAI/ACM Conference on AI, Ethics, and Society (AIES 2026).