- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
EchoRouter optimizes multi-agent systems that can change their collaboration structure during a task. It uses execution experience and LLM forecasts to select policies offline, then a trained controller uses the selected policy and intermediate results to decide which agents to call next or when to stop. Experiments across reasoning, coding, and tool-use tasks report favorable quality–cost trade-offs.
Critical strengths
- Runtime adaptation is useful and well motivated. The controller can respond to intermediate evidence, allowing the system to spend additional calls where verification or repair is needed.
- The optimization method has a clear empirical basis. Matched comparisons help attribute failures to models or prompts, while forecasts prioritize candidate policies for expensive evaluation. The ablations support the contribution of these mechanisms.
Critical weaknesses
- The distinct contribution relative to prior work is not yet clear enough. AgentConductor also changes multi-agent topology in response to execution feedback [1], while AgentSwift uses value-guided search to reduce agent-design cost [2]. The paper needs to establish what its combination of offline experience and runtime control achieves beyond these approaches.
- The evidence for the quality–cost claim has limited scope. The forecast analysis does not show how reliably candidates are selected across all task domains and optimization rounds. Online cost excludes the compute cost of the local controller, so the reported trade-off does not fully characterize deployment cost.
[1] AgentConductor: Topology Evolution for Multi-Agent Competition-Level Code Generation. [2] AgentSwift: Efficient LLM Agent Design via Value-guided Hierarchical Search.
Questions for authors
- Across task domains and optimization rounds, how often does forecasting select the best measured candidate under the cost constraint?
- How does the quality–cost comparison change when local controller inference and training costs are included?