Published January 23, 2026 | Version v1
Working paper Open

When AI Acts on Matter: Why Physical AI Systems Cannot Be Governed Like Software

Authors/Creators

Description

As artificial intelligence systems increasingly transition from digital decision-making to direct control of physical processes, materials, and environments, prevailing AI governance models encounter fundamental limitations. In physical AI systems, decisions are not merely informational outputs but executable actions that act on matter, energy, and infrastructure. These actions occur at machine speed, under conditions of uncertainty, partial observability, and irreversibility, often without meaningful opportunity for human intervention. When failures occur, outcomes cannot be rolled back, patched, or mitigated through post-hoc analysis or explanation.

This paper argues that treating physical AI as an extension of software-based AI governance constitutes a category error. Existing governance mechanisms—such as documentation, audits, explainability, and human oversight—were designed for systems where errors can be detected and corrected after execution. In physical AI systems, risk concentrates at the moment of execution, where authority to act, safety assumptions, and uncertainty thresholds must be evaluated and enforced in real time.

By examining recurring failure patterns across industrial, energy, healthcare, and cyber-physical deployments, the paper identifies the structural characteristics that make physical AI uniquely hazardous when governed solely through declarative or retrospective controls. It contends that effective governance of physical AI requires enforceable, execution-level constraints that operate deterministically at machine speed and are capable of preventing or degrading actuation when conditions fall outside defined bounds.

The analysis concludes that future regulatory and system design approaches must shift from governance as oversight to governance as execution control. In physical AI systems, trust, safety, and control can only be established if systems are technically capable of constraining their own actions at the moment of execution.

Files

Physical AI Governance.pdf

Files (78.2 kB)

Name Size Download all
md5:adf2d17115936fb21b2b4e36f1513fc0
78.2 kB Preview Download