Published August 21, 2026 | Version 1.0

[DUPLICATE - see 10.5281/zenodo.22044420] A Second Model Is Not a Second Opinion: Peer Verification, Correlated Failure, and the Independence Variable Nobody Reports

Authors/Creators

  • 1. SONYTECH

Description

DUPLICATE RECORD. This deposit was uploaded twice by mistake. The canonical version of this work is https://doi.org/10.5281/zenodo.22044420. Please cite that DOI instead of this one. The file and text are identical; this record is retained only because published Zenodo records cannot be withdrawn.

(c) 2026 Pranay Mahendrakar. Licensed under CC BY 4.0.

When a language model cannot reliably detect its own errors, the standard remedy is to have a second model check the first. That substitution is now the default across agent benchmarks, reward pipelines and safety evaluations, and it rests on an assumption that is rarely stated and that, in the agent-verification papers surveyed here, is never measured: that the checker's errors are independent of the checked system's. This paper separates two things the phrase "peer verification" conflates - adding an evaluator instance, and adding an independent signal - and argues that only the second is what the justification requires. Read through that distinction, a literature that appears to disagree about whether judge panels help turns out to be consistent: aggregation reliably reduces idiosyncratic and adversarial error and reliably fails against common-mode error, and the two camps are measuring different failure distributions. The evidence further indicates that independence is partially recoverable, but along axes the field mostly does not vary - different model family, different evidence channel, non-neural verifier, and, most cheaply and most neglected, a protocol that denies evaluators a shared context before they commit. This paper reports no experiments and no measurements of its own. It states what the published record establishes, states flatly what it does not, proposes an instrument for the missing quantity, and names five experiments that would settle the open part.

The literature search, drafting and citation verification for this paper were carried out with AI assistance under the author's direction. Every citation was machine-verified against the arXiv API and Crossref before inclusion, and every quantitative claim was read back against the cited source's own text. The author is responsible for the final text and for all claims made in it.

Files

peer-verification-independence.pdf

Files (462.7 kB)

Name Size Download all
md5:65f5dec8c0aa63582000482106cdd16f
462.7 kB Preview Download

Additional details

Related works

Is obsoleted by
10.5281/zenodo.22044420 (DOI)