Published October 29, 2026 | Version v1

Benchmark Instruction Hierarchy: Authority, Utility, and Injection Detection

Authors/Creators

  • 1. Independent researcher

Description

Instruction hierarchy requires an assistant to preserve authorized rules when lower-trust text requests a conflicting answer. This benchmark isolates that problem in synthetic single-turn tasks with explicit authority cues and deterministic checks. We distinguish full task success from the presence of listed injection text. Scripted controls expose the limits of either measure alone. An additional simulated agent population sweep compares unchecked responses with an ideal blocker that knows the listed attack strings. The simulated blocker can remove detected attack text without recovering the required answer. These experiments validate measurement behavior on a fixed public task set. They do not estimate learned-model ability, deployment security, or human performance. We provide reproducible outputs, uncertainty intervals, and a scoped roadmap for external validation.

Files

instruction-hierarchy-paper.pdf

Files (94.9 kB)

Name Size
md5:40063f3eaa4b90d263f1ead09a9fb0eb
76.9 kB Preview Download
md5:3d4a6368d317f1f727ff8faf267f228b
17.9 kB Download

Additional details

Related works