Scaling Multi-Agent Intelligence with Substrate-Centric Coordination
cs.CL, cs.MA
Submitted: 2026-10-12
Updated: 2026-10-12
Code: https://github.com/huggingface/smolagents
License: http://creativecommons.org/licenses/by/4.0/
The gist: Existing large language model (LLM) based multi-agent systems have been shown to scale poorly, and we identify three problems: reading burden that grows with the group, useful information diluted by
Abstract
Existing large language model (LLM) based multi-agent systems have been shown to scale poorly, and we identify three problems: reading burden that grows with the group, useful information diluted by shared work of unknown quality, and fragility to failed agents. We argue that the problems are largely due to agent-centric designs: the coordination structure is wired into fixed workflows, central coordinators, or peer-to-peer messaging, and recent blackboard-style methods that move the coordination into a shared medium relieve only the last problem. To close the gaps, we build ScaleMAS, where asynchronous agents interact with a shared datastore of linked messages via three operations: publishing messages with optional references to earlier ones that they build on, searching for messages by content, and visiting messages by address. Search returns at most k messages, so an agent's read stays bounded at any group size; results are ranked by relevance and by how often they are cited, which we find to be an effective proxy for quality; and messages persist after their producers leave, so the group carries on when individual agents fail. Across four agentic tasks, ScaleMAS outperforms agent-centric and blackboard-style baselines at lower inference compute, continues to scale up to 128 agents, and tolerates losing agents midway.
Sources
- BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agent
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks
- Exploring Advanced LLM Multi-Agent Systems Based on Blackboard Architecture
- Multi-Agent Transactive Memory
- Message Passing Enables Efficient Reasoning
- Decentralized Multi-Agent Systems with Shared Context
- Scaling Discovery through Test-Time Communication
- CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery
- AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration
- Beyond Compaction: Structured Context Eviction for Long-Horizon Agents
- Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG
- Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMs
- ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
- ContextBudget: Budget-Aware Context Management for Long-Horizon Search Agents
- ReAct: Synergizing Reasoning and Acting in Language Models
- G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks
- Language Agents as Optimizable Graphs
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering