Published June 4, 2026
| Version v1.0.0
Software
Open
Transport, Not Computation: A Cross-Model Falsification Program on How 1B-3B Language Models Use Long Context
Authors/Creators
Description
An umbrella review of a program of pre-registered, matched-control causal experiments on small open language models (Llama-3.2-1B/3B, Qwen2.5-3B). After establishing that long-context retention has no critical key budget (the sparse compressor is not the limit), four independent causal gates - on attention, on the repair of retrieval-disambiguation failure, on multi-hop synthesis, and on a directly-optimized latent state - converge on one regime-bounded thesis: the network delivers and composes only through an external buffer; it does not latently compute, and a latent computation state cannot be optimized into existence. The contribution is a map of the boundary of internal competence, a training-free long-context engine plus a 27-byte micro-hint memory architecture, and a falsification methodology that reversed its own false positives.
Notes
Files
Seqev/transport-not-computation-v1.0.0.zip
Files
(419.9 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:9d0972beca114ff492e1da2f1cae0e42
|
419.9 kB | Preview Download |
Additional details
Related works
- Is supplement to
- Software: https://github.com/Seqev/transport-not-computation/tree/v1.0.0 (URL)
Software
- Repository URL
- https://github.com/Seqev/transport-not-computation