Published April 28, 2026
| Version v2
Preprint
Open
Per-Object Slot Decomposition for Scalable Neural World Modeling: When Does Attention Beat Mean-Field?
Description
We investigate the inductive biases required for neural networks to learn multi-object physical dynamics and generalize to long-horizon prediction. We propose SlotCTM, an object-centric architecture combining per-object computational slots with CTM recurrence. Our central finding is a density-dependent crossover between GNN attention and mean-field aggregation, consistent with classical mean-field theory. Under partial observation at N=12, GNN attention exhibits initialization-sensitive instability: with one seed it diverges catastrophically (MSE=334), yet with another it converges to MSE=0.029, beating mean-field (0.033). Shannon entropy analysis confirms attention oversquashing at high density. DuoNeural AI Research Lab, April 2026.
Files
paper3_SlotCTM_DuoNeural.pdf
Files
(882.7 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:51322c01067cfbca83f9d63600dee809
|
882.7 kB | Preview Download |