- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors proposed TGO-MAS that models LLM multi-agent interaction as a step-aware scheduling problem, where a closed-loop organizer processes execution history and uses separate readiness and value heads to score candidate actions, and selects feasible steps under budget constraints, and replans based on real-time feedback.
Critical strengths
- The framing is clear and novel: compared to static topologies and post-hoc traces based organizations of multi-agent interactions, the proposed method treats agent interaction activation timing as explicit decision variables, illustrated by examples, which facilitates optimizations such as dynamic planning aware of execution status.
- Solid and well-motivated problem formulation. The authors modeled a real-world scenario in a clear way, defining the typed temporal decision objective, and hence formulating prefix online scheduling and task objective. Clean and easy to follow.
- Promising experimental study was proposed, showing stronger results compared to existing static and dynamic baselines across benchmark datasets. It is worth noting that the proposed method achieved improved performance with reduced token consumption.
Critical weaknesses
- Minor: In Section 3 it may help to have a list of the definition not only for the notations, but also for the operations.
- The experimental study is sort of bound to a fixed small number of agents and limited task domains, which may not effectively illustrate the application towards various real settings. For example, as the number of agents increases, a graph node may become a super node connecting to many other nodes which implies a possible information propagation bottleneck, and hence impacts the planning and scheduling.
- The authors should clarify if the proposed mechanism is confounded with the ablation design. The authors concede this caveat, but should address it in the experiment or clearly call out its impact in the experimental observations.
- The paper acknowledges that its findings cannot claim statistical significance or proven superiority over baselines. While I appreciate the honest of the authors, it brings some confusion on how to properly interpret the experimental observations. The authors should clarify it.
Questions for authors
n/a