Published April 18, 2026 | Version 1
Preprint Open

Aethon: Toward a Memory-Native Post-Transformer Foundation Model

Description

This paper presents the design thesis behind Aethon, a non-transformer foundation model architecture developed by OkeyMeta Ltd as a memory-native alternative to attention-dominant language models.

The central claim is that long-context intelligence should emerge from structured state evolution, selective memory, and recurrent composition — rather than from repeated quadratic context fusion. We describe the motivation, high-level architecture, training discipline, scaling logic, and efficiency rationale behind Aethon, while deliberately withholding implementation details that constitute proprietary advantage.

Aethon is organised around a proprietary architecture family internally referred to as L-SBM (not a transformer, not a Mamba derivative), and is designed around five goals: native long-context handling, persistent compressed memory, strong reasoning capacity, grounded response behaviour, and parameter efficiency.

We further position Aethon relative to transformer models and recent state-space architectures such as Mamba, arguing that the next competitive frontier lies not in marginal transformer refinement but in memory-first model design.

This is a strategic research draft. Implementation details are intentionally withheld. All rights reserved — © 2026 OkeyMeta Ltd.

Files

Aethon_Research_Paper_2026_Final.pdf

Files (20.0 kB)

Name Size Download all
md5:f7b134b7c6a4d62c7a754a55df5a3936
20.0 kB Preview Download

Additional details

Additional titles

Alternative title (English)
Aethon: Reframing Foundation Models Around Memory Rather Than Attention
Alternative title (English)
Beyond Attention: A Memory-Native Architecture for Long-Context Foundation Models
Alternative title (English)
Post-Transformer Language Modeling with Memory-Native Recurrent Computation
Alternative title (English)
Rethinking Long-Context Intelligence: The Aethon Memory-Native Architecture

Dates

Copyrighted
2026-04-18

Software

Development Status
Active