Published May 15, 2026 | Version v1
Preprint Open

Relevance Requires Non‑Markovian Conditioning: Empirical Proof that Goal‑Directed Generation Demands Bidirectional Context

  • 1. Independent Researcher, Kolkata, India

Description

We demonstrate that the ability to produce relevant (goal‑directed) text is architecturally distinct from the ability to produce coherent (statistically fluent) text. Using a controlled text‑generation simulation, we show that a unidirectional Markovian language model achieves 0% relevance on novel compositional goals, while bidirectional and multidirectional models (Seq2Seq LSTM and Transformer) achieve 100% relevance. The clean 0% vs. 100% split provides the first empirical proof that relevance requires non‑Markovian conditioning, and that coherence and relevance are fundamentally different dimensions of text quality.

Files

EUREKA.txt

Files (42.3 kB)

Name Size Download all
md5:eabcce1a0144989de7917f545277b45f
7.6 kB Preview Download
md5:7cbb10eecae2754a2e27ede83ccf76b0
19.2 kB Preview Download
md5:b7e223c640f91ae1aa74a1053c353f45
15.5 kB Preview Download