There is a newer version of the record available.

Published July 3, 2026 | Version v1

Agreement Is Not Truth: How LLM Juries Converge Confidently on Legally False Answers

  • 1. Independent Researcher; MBA in Applied AI (FMA/PARETO)

Description

Using a panel of Large Language Model judges to score and select answers — "LLM-as-jury", increasingly the default stopping criterion for agent loops and multi-model consensus pipelines in reward-free domains — rests on an unexamined assumption: that when diverse judges agree, their agreement tracks correctness. We test this on a legally-anchored gold set (N=16 Brazilian tax and labor cases, good/bad labels grounded in verified official statutes, not opinion), scored by three judges from distinct model families (GLM-4.6, GPT-4o-mini, Llama-3.3-70B). We report three findings. (A1) The panel discriminates well overall — accuracy 0.938, Youden 0.875 — and beats every single judge (best solo 0.875), confirming the classic ensemble benefit. (A2) Yet the panel remains blind or inconsistent on exactly the two most dangerous error types in law: it gave a top score of 10.0 to an answer that applied real statutes to the wrong case (wrong subsumption), and nearly passed (9.0) an answer that cited a statute which does not exist (non-existent norm). The failure is systematic, not stochastic: both error types are lexically fluent and legally plausible, and plausibility is what an LLM judge measures. Critically, judge diversity does not rescue the panel, because the three families share a training corpus (the legal web) and therefore share the same blind spots — architectural diversity reduces idiosyncratic variance but not corpus-level correlated error. We conclude that jury agreement is a valid proxy for form and completeness but not for factual truth, that the top-compression of LLM judges makes the Youden-optimal acceptance threshold anomalously high ( =9.5), and that any pipeline delegating a correctness decision to a jury inherits a floor of confident, high-scoring error. The practical consequence: factual verification must be an external gate, not a jury vote. : LLM-as-judge, LLM jury, multi-model consensus, ensemble evaluation, reward-free evaluation, confident error, hallucination detection, legal NLP, calibration, Youden threshold, corpus correlation, agent loops.

Files

paper.pdf

Files (293.8 kB)

Name Size
md5:7f5e82d785868600e54c9532de99774b
293.8 kB Preview Download