Published July 29, 2026 | Version v1

Reality-Constrained Artificial Intelligence (RCAI): A Purely Information-Theoretic Framework for Hallucination Reduction via Logit Projection

Authors/Creators

Description

Large Language Models (LLMs) generate text by sampling from probability distributions over high-dimensional vocabularies. While highly capable, such systems may produce outputs that violate factual, logical, structural, or domain-specific constraints. Existing approaches—including fine-tuning, Reinforcement Learning from Human Feedback (RLHF), Retrieval Augmented Generation (RAG), and post-hoc verification—reduce but do not eliminate invalid generations during decoding. This paper introduces Reality-Constrained Artificial Intelligence (RCAI), a constrained-decoding framework that enforces explicit invariants at inference time through projection of model logits onto a dynamically validated admissible token set. We formalize the notion of a Truth Subspace, define a Constraint Projection Operator acting directly in logit space, and prove that any token excluded by the active constraint system has zero sampling probability under RCAI decoding. For practical deployment, we introduce approximate constraint manifolds constructed from formal logic systems, knowledge graphs, retrieval modules, and semantic entailment validators. We derive error bounds relating residual hallucination probability to the false-positive mass of the approximate constraint system. RCAI is model-agnostic and can be integrated with existing autoregressive architectures without retraining. 

Files

RCAI.pdf

Files (312.6 kB)

Name Size Download all
md5:6d4056ec991dad5889e4302b873135fa
306.0 kB Preview Download
md5:ea2b4986c82a8f05e67c8d3a445786fc
6.6 kB Preview Download