Published March 8, 2026
| Version v2
Publication
Open
DREAM: Dynamic Recall and Elastic Adaptive Memory on Machine Learning
Description
DREAM is a novel neural architecture that enables real-time, in-situ parameter adaptation during inference. By integrating Active Inference and Spike-Timing-Dependent Plasticity (STDP), it overcomes the static constraints of Transformers and LSTMs.
Core Mechanisms:
- Slow-Fast Weights: Resolves the stability-plasticity dilemma by separating long-term invariants from elastic contextual updates.
- Surprise Gate: A homeostatic regulator that triggers plasticity only upon detecting structural novelty, preventing overfitting to noise.
- Low-Rank Updates: Ensures computational efficiency for Edge AI by restricting adaptations to a compact feature subspace (r=16).
- Liquid Time-Constants (LTC): Dynamically adjusts information integration rates to instantly discard outdated context during anomalies.
Key Results: On non-stationary audio tasks (LJ Speech), a 82K parameter DREAM model achieved a 99.9% error reduction, outperforming stasis-bound models (LSTM 893K, Transformer 551K) through millisecond-scale self-calibration
Files
DREAM_NN-3.pdf
Files
(393.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:27fde2878508256f8a965b3084212b39
|
393.0 kB | Preview Download |