Published June 19, 2026
| Version v1
Preprint
Open
RCLA: Resonance-Coded Language Architecture — Template Routing as an Alternative to Transformer Feed-Forward Layers
Description
We present RCLA, a language model architecture replacing transformer feed-forward layers with sparse template routing over a learned codebook. RCLA v2 (699M parameters) achieves 13.4% lower cross-entropy loss than a 838M-parameter transformer baseline on identical training data, while training 1.61x faster.
Files
rcla_paper.md
Files
(11.3 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:43aa1d31d5dd3c213131268a2bf2e7c4
|
11.3 kB | Preview Download |