Published October 16, 2026 | Version v1

Preregistered Adversarial Batteries: A Falsifiable Protocol for Security-Testing Autonomous AI Systems

Authors/Creators

  • 1. SQUIRL OS Technologies LLC

Description

Security testing of autonomous AI systems suffers from a credibility gap: penetration-test reports are private, vendor claims are selectively disclosed, and red-team outcomes are published only when favorable. This preprint introduces Preregistered Adversarial Batteries (PAB), a protocol importing preregistration from clinical-trial science into security operations: every falsifier (a specific attack with a predicted verdict) is specified and publicly committed before execution; adjudication is deterministic with no language model in the decision path; results are written to an append-only public ledger and DOI-stamped. Critical events are scored as hold-by-design verdicts: the predicted outcome is that the system fails closed and waits for a human decision, so a refusal counts as a pass.

Application to a self-healing AI infrastructure platform across six batteries reconstructing the declassified NSA BULLRUN-era tradecraft (operational faults, upstream context poisoning, cryptographic subversion, supply-chain interception, monitoring integrity, lawful compulsion): 30 falsifiers, 30 predicted verdicts, zero unexpected outcomes, six holds-by-design each adjudicated by the human operator through a verified channel. Three protocol imperfections (a missed execution window, a preregistration self-detection, a scoring amendment) are disclosed as misses in the public record, demonstrating the miss-disclosure mechanism functions. Limitations are stated plainly: self-adjudication, synthetic injections against a prototype system, and single-operator governance; the replication kit is released to answer them.

The contribution is not the pass rate — it is the format: a security test whose conclusions were committed before its data existed.

This software is a prototype and is provided for educational and research purposes only. It is not intended for production use, commercial deployment, or safety-critical environments. All systems are experimental and may contain defects.

Files

pab_methodology_preprint_v1.md

Files (14.9 kB)

Name Size
md5:e2091d047a25ce5bb77e7f93c36e28b6
14.9 kB Preview Download

Additional details