Aethon: Toward a Memory-Native Post-Transformer Foundation Model
Authors/Creators
- 1. OkeyMeta Ltd
Description
This paper presents the design thesis behind Aethon, a non-transformer foundation model architecture developed by OkeyMeta Ltd as a memory-native alternative to attention-dominant language models.
The central claim is that long-context intelligence should emerge from structured state evolution, selective memory, and recurrent composition — rather than from repeated quadratic context fusion. We describe the motivation, high-level architecture, training discipline, scaling logic, and efficiency rationale behind Aethon, while deliberately withholding implementation details that constitute proprietary advantage.
Aethon is organised around a proprietary architecture family internally referred to as L-SBM (not a transformer, not a Mamba derivative), and is designed around five goals: native long-context handling, persistent compressed memory, strong reasoning capacity, grounded response behaviour, and parameter efficiency.
We further position Aethon relative to transformer models and recent state-space architectures such as Mamba, arguing that the next competitive frontier lies not in marginal transformer refinement but in memory-first model design.
This is a strategic research draft. Implementation details are intentionally withheld. All rights reserved — © 2026 OkeyMeta Ltd.
Files
Aethon_Research_Paper_2026_Final.pdf
Files
(20.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:f7b134b7c6a4d62c7a754a55df5a3936
|
20.0 kB | Preview Download |
Additional details
Additional titles
- Alternative title (English)
- Aethon: Reframing Foundation Models Around Memory Rather Than Attention
- Alternative title (English)
- Beyond Attention: A Memory-Native Architecture for Long-Context Foundation Models
- Alternative title (English)
- Post-Transformer Language Modeling with Memory-Native Recurrent Computation
- Alternative title (English)
- Rethinking Long-Context Intelligence: The Aethon Memory-Native Architecture
Dates
- Copyrighted
-
2026-04-18
Software
- Development Status
- Active