Published June 4, 2026 | Version v1.0.0

Transport, Not Computation: A Cross-Model Falsification Program on How 1B-3B Language Models Use Long Context

Description

An umbrella review of a program of pre-registered, matched-control causal experiments on small open language models (Llama-3.2-1B/3B, Qwen2.5-3B). After establishing that long-context retention has no critical key budget (the sparse compressor is not the limit), four independent causal gates - on attention, on the repair of retrieval-disambiguation failure, on multi-hop synthesis, and on a directly-optimized latent state - converge on one regime-bounded thesis: the network delivers and composes only through an external buffer; it does not latently compute, and a latent computation state cannot be optimized into existence. The contribution is a map of the boundary of internal competence, a training-free long-context engine plus a 27-byte micro-hint memory architecture, and a falsification methodology that reversed its own false positives.

Notes

If you use this work, please cite it as below.

Files

Seqev/transport-not-computation-v1.0.0.zip

Files (419.9 kB)

Name Size Download all
md5:9d0972beca114ff492e1da2f1cae0e42
419.9 kB Preview Download

Additional details

Related works