Published June 19, 2026 | Version v1

RCLA: Resonance-Coded Language Architecture — Template Routing as an Alternative to Transformer Feed-Forward Layers

Authors/Creators

  • 1. NE-OS SpA, Chile

Description

We present RCLA, a language model architecture replacing transformer feed-forward layers with sparse template routing over a learned codebook. RCLA v2 (699M parameters) achieves 13.4% lower cross-entropy loss than a 838M-parameter transformer baseline on identical training data, while training 1.61x faster.

Files

rcla_paper.md

Files (11.3 kB)

Name Size Download all
md5:43aa1d31d5dd3c213131268a2bf2e7c4
11.3 kB Preview Download