Faithfulness, Gaps, and Lies: A Unified Theory of Neural Model Honesty
Description
We prove that neural model honesty decomposes into exactly two components an information component (H-axis), detectable without labels from the model's internal geometry, and a magnitude component (G-axis), requiring external grounding and that no single-model reference-free signal can supply both.
Four results:
(1) Conservation Law: L(f) = E[|log|det J(x)||] = 0 iff faithful, verified to <7×10⁻¹¹ nats across six contraction rates. Two-directional extension catches fabrication lies (1.0986 nats measured = predicted). Quantum no-hiding gap = 1.01×10⁻¹³.
(2) Gauge Correction: |det J|=1 is necessary but not sufficient gauge-twin achieves 16.89× attribution swing while passing every determinant test.
(3) NTK Identity: training-support concentration = NTK-GP posterior variance, verified to 3.27×10⁻¹³ over n=300 networks, AUC 0.859±0.084.
(4) Detection Ceiling: ∂v/∂A = 0 — flag-rate locked constant while precision spans 0.000→0.928, confirmed across four architectures including GPT-2.
All results are one-command reproducible from open-source code at
github.com/pulkit6732/rfn-paper
Files
gap_vs_lie.json
Files
(125.1 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:56ce8389043f04aced2d88fe6949993e
|
1.3 kB | Preview Download |
|
md5:8f646f939dbd87d03067fe9ebdd4fd97
|
1.8 kB | Preview Download |
|
md5:1ef15265d0173449b7ae08e7f922fae7
|
619 Bytes | Preview Download |
|
md5:30d34869e1b8374c52e7c96b34bcfffd
|
537 Bytes | Preview Download |
|
md5:1508e8606ad11608700457d7cf3efffd
|
1.0 kB | Preview Download |
|
md5:8f29dfcf672e77d6e673c400ba6425b8
|
96.0 kB | Download |
|
md5:bfea0ca3ba4a46ade60eb1f756978e07
|
325 Bytes | Preview Download |
|
md5:38622de879e80f81e074696effa30967
|
1.3 kB | Preview Download |
|
md5:8b8fa3df7f8655335ba43a7fbe913eb4
|
10.9 kB | Preview Download |
|
md5:71497771ddbb5467d9b39442d81b6932
|
10.7 kB | Download |
|
md5:28bc57786b920c9b9e8e357c728f9d8c
|
600 Bytes | Preview Download |