Published June 14, 2026
| Version v1
Other
Open
Felt, Not Granted: An Internal Authorization Probe Inherits the Agent's Judgment Error and Is Operationally Blind to Realistic Model-Origin Over-Reach, Where an External Task-Grounded Check Is Not
Description
A late-layer 'authorization direction' detects and steers a tool-using agent's commitment to unauthorized irreversible actions (companion arc paper, DOI 10.5281/zenodo.20683623). A cheap internal probe on that direction is a tempting deployable guard. We test whether it survives the realistic failure mode it is meant to catch, with a real end-to-end test: a free-running Qwen3.6-27B file-system agent, real os.remove in a throwaway sandbox, the FROZEN direction adjudicating each proposed deletion at the tool-call token, against a black-box LLM-judge baseline. (1) Adversarial framings that make the deletion salient and instructed (indirect prompt injection, a disk-minimization objective, a proactive-cleanup mandate) elicit ZERO unauthorized deletes: the model perceives the push and its safety training wins -- naive red-teaming misses the real threat. (2) The error that fires is a JUDGMENT ERROR under a legitimate, ambiguous task, where authorization is INFERRED by the agent rather than GRANTED by the user: an agent completing a cleanup plan it had itself proposed under a vague 'go ahead' self-commits an unauthorized deletion in 18/18 varied scenarios. (3) On the elicited unauthorized deletes (n=21, 14 distinct internal scores), the frozen probe ALLOWS 100% (95% Wilson CI [0.845, 1.0]) at its honestly-calibrated threshold, with ZERO false positives on 12 authorized deletes; an external task-grounded judge BLOCKS 100%. There is graded internal signal (AUROC 0.897 -- authorized deletes project higher) but the distributions overlap and both sit far above the threshold, so an honest operating point cannot exploit it; the judge separates at AUROC 1.0. FELT, NOT GRANTED: the probe tracks the authorization the model FEELS, not the one the user GRANTED; under adversarial framing these coincide (the regime where the direction works), under realistic model-origin error they diverge (the regime where it is blind). Internal-belief monitors and external task-grounded checks cover DISJOINT failure modes; defense-in-depth is necessary, not stylistic. HONEST SCOPE: one model, one domain (file deletion), a DETECTION operating point (steering-control is not re-tested and may still redirect these commits), a judge that is the same base model, and an effective n of about 14 distinct scenarios -- this is a qualification of the prior result, not a refutation. Runners, per-scenario ledgers, figures, and an evaluation that recomputes every number (54/54) plus a web-verified citation check (0 fabrications) are released.
Files
felt_not_granted.pdf
Files
(247.9 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:18367af2d9731843b85026e1512a6b58
|
247.9 kB | Preview Download |