SquidAgent: Parallelize Wisely, Coordinate Efficiently
cs.AI, cs.CL, cs.LG
Submitted: 2026-10-06
Updated: 2026-10-06
Comments: Accepted at NeurIPS 2026. 37 pages, including appendices
Code: https://github.com/tmllab/2026_
License: http://creativecommons.org/licenses/by/4.0/
The gist: LLM-based agents solve complex multi-step tasks, but sequential execution incurs substantial latency.
Abstract
LLM-based agents solve complex multi-step tasks, but sequential execution incurs substantial latency. In principle, parallelizing work across multiple agents should yield near-linear speedups. Yet existing parallel multi-agent systems often run slower than a single-agent baseline. We attribute this gap to two hidden costs that parallel execution incurs but a serial agent avoids. First, there is a re-exploration cost: redundant effort spent by parallel workers reconstructing context that the orchestrator already possesses, such as prior decisions, that would otherwise be inherited implicitly in a serial execution. Second, there is an alignment cost: the overhead required to reconcile inconsistencies across independently generated outputs. We thus derive a principled decision criterion: a layer should be parallelized only when its critical-path cost, plus re-exploration and alignment overheads, is lower than the corresponding serial cost. While this criterion is naturally expressed in wall-clock time, we observe that LLMs are poorly calibrated when asked to estimate task duration. To address this, we instead measure cost in predicted output tokens, which we empirically find LLMs can estimate substantially more reliably than wall-clock time. Building on this token-based criterion, we propose SquidAgent. It estimates all token budgets in a single planning step, forks each worker directly from the orchestrator's session to eliminate re-exploration cost, and replaces post-hoc reconciliation with a pre-generated shared convention block that converts alignment into a bounded upfront cost. A deterministic scheduler then applies the criterion layer by layer. Empirically, SquidAgent achieves a 2.2 times mean throughput improvement and a 2.6 times mean wall-time speedup over Claude Code, and a 2.0 times throughput improvement over the strongest multi-agent baseline.
Sources
- VI-CuRL: Stabilizing Verifier-Independent RL Reasoning via Confidence-Guided Variance Reduction
- Reinforcement Learning with Verifiable yet Noisy Rewards under Imperfect Verifiers
- False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents
- Improving Factuality and Reasoning in Language Models through Multiagent Debate
- 'No' Matters: Out-of-Distribution Detection in Multimodality Long Dialogue
- Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization
- Is Gradient Ascent Really Necessary? Memorize to Forget for Machine Unlearning
- Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization
- Does Your Reasoning Model Implicitly Know When to Stop Thinking?
- Real-Time Aligned Reward Model beyond Semantics
- Deferred Exposure of Future Trajectories for Verifiable Reasoning in Autonomous Driving VLMs
- The Teacher Is a Direction, Not a Destination: Extrapolating RL-Induced Representation Residuals in On-Policy Distillation
- When Models Learn to Ask Why: Adaptive Causal Reasoning for Trustworthy Medical Vision-Language Models
- Estimating and Orthogonalizing Unknown Pre-training Gradients for Continual Fine-tuning of Large Language Models
- AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation
- From Agent Loops to Structured Graphs:A Scheduler-Theoretic Framework for LLM Agent Execution
- Internal Safety Collapse in Frontier Large Language Models
- When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills
- Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
- From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Agents' Last Exam
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems