Scaling Limits in Distributed Multi-Agent Systems: A Practical Survey
Authors/Creators
Contributors
Researcher (2):
Description
Engineers building distributed multi-agent systems routinely overestimate how well their systems will scale. This paper surveys the mathematical results that explain why and what to do about it. We examine three classes of hard limits: (1) communication complexity forcing quadratic message growth, (2) consensus algorithm instabilities that emerge at scale, and (3) network effect phase transitions that cause unpredictable failures. Flat coordination hits practical limits around 100 agents. We then examine what works: hierarchical architectures, adaptive algorithms, weak coupling, and monitoring for phase transitions. We synthesize results from distributed computing, control theory, and statistical physics to provide both a realistic picture of scaling limits and practical guidance for building systems that work at scale.
Files
scaling_limits_final.pdf
Files
(181.0 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:0b2b62bf0e33f9a03768e4ad55610001
|
181.0 kB | Preview Download |
Additional details
Dates
- Created
-
2025-12-28
References
- C. Berger and H. P. Reiser, "Scaling Byzantine Consensus: A Broad Analysis," Proc. 2nd Workshop on Scalable and Resilient Infrastructures for Distributed Ledgers, 2018.
- S. Alqahtani and M. Demirbas, "Bottlenecks in Blockchain Consensus Protocols," IEEE COINS, 2021.
- A. D. Saravanos, Y. Li, and E. A. Theodorou, "Distributed Hierarchical Distribution Control for Very-Large-Scale Clustered Multi-Agent Systems," arXiv:2305.18718, 2023.
- E. Tegling, B. Bamieh, and H. Sandberg, "Scale fragilities in localized consensus dynamics," Automatica, vol. 153, 2023.
- K. Cui et al., "A Survey on Large-Population Systems and Scalable Multi-Agent Reinforcement Learning," arXiv:2209.03859, 2023.
- G. Qu, Y. Lin, A. Wierman, and N. Li, "Scalable Multi-Agent Reinforcement Learning for Networked Systems," NeurIPS, 2020.
- A. Lucas, "Nonequilibrium phase transitions in competitive markets caused by network effects," PNAS, vol. 119, no. 40, 2022.
- C. Jin, C. Song, J. Bjelland, G. Canright, and D. Wang, "Emergence of scaling in complex substitutive systems," Nature Human Behaviour, vol. 3, no. 8, 2019.
- L. Wu, J. Zhang, M. Zhao, and L. Lü, "Scaling behaviours in the growth of networked systems," Scientific Reports, vol. 5, 2015.