On the Structural Requirements for Coherent Reasoning in Language Models

Recent empirical work reveals a systematic failure mode in Large Language Models (LLMs): models that perform well on static benchmarks often fail to maintain coherence across sequences of inferences. Specifically, models may estimate probabilities accurately but place bets that contradict them; confidence signals often fail to predict commitment to an answer; and belief updates after new evidence can paradoxically degrade accuracy.

This paper argues that these are not merely calibration issues but consequences of a fundamental architectural limitation: stateless inference. Current architectures generate rich internal representations (confidence, correctness predictions, epistemic metadata) during a forward pass but discard them immediately upon output generation. Consequently, the model lacks the persistent substrate required to bind distinct inferences into a coherent reasoning chain.

Building on the Tension Principle, this work outlines the Minimal Architecture required to bridge the gap between local competence and temporal coherence. It proposes four necessary structural additions:

• Temporal Persistence: Rolling logs that retain internal states, not just textual outputs.
• Self-Referential Checking: Mechanisms to compute "tension" between predicted reliability and actual performance.
• Delta-Tracking: Stability signals that detect brittleness in reasoning independent of ground truth.
• Resolution Mechanisms: Feedback loops that use these signals to modulate future behavior.

The paper concludes by contrasting "Psychological" alignment approaches (which assume a continuous agent) with Ecological and Architectural strategies that are better suited to the transient nature of LLM instantiations.