- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
this paper introduce phase-scoped dynamic leadership for embodied LLM teams: agents exchange compact evidence, jointly select a coordinator and phase objective, execute a phase DAG, and replicate progress across coordination rounds. the experiments demonstrated Dynamic achieves 9/30 terminal successes versus Static’s 1/30, at 1.55 times the mean LLM-call count. the paper demonstrated an explicit account of the information and cost conditions that motivate transferable authority the paper also provides a reproducible evaluation separating task-level outcomes, inference use, and actual leader changes, including all run summaries and all recorded leadership sequences.
Critical strengths
The comparison between static and dynamic coordination provides a useful perspective on the role of agent-specific information in multi-agent systems planning. Use the same LLM across both settings helps isolate the effect of coordinator assignment from differences in model capabilities. The phase based framework represents tasks as dependency graphs, provides a structured and interpretable approach to this problem.
Critical weaknesses
I am still not clear theoretically how to prove Dynamic outperforms static, because the static coordinator also has some information. There are limited methodology novelty. The paper compares static and dynamic coordinator assignment, but lack of theoretical support. The technical contribution is unclear. After reading the paper, I am not clear what new algorithms distinguishes this work from existing multi-agent systems. I think the research contribution isn't enough for top tier conferences.
Questions for authors
the notations make me confusing, for example, "l' in line 192 which says it's a incubator is different from the "l" in line 139 which says it's coordinator How does the proposed framework decide which agent has the most decision relevant information at different phases? Is there a quantitative measure of information sufficient enough to guide coordinator election? in table 4, both static and Dynamic success rate are pretty low, though dynamic is a little bit better than static. I am not convinced the proposed coordination mechanism is effective or reliable.
Thank you. We do not claim that Dynamic theoretically dominates Static. The information-sufficiency result explicitly allows a fixed coordinator to perform equally well when shared advice contains the decision-relevant information. Any advantage of transferring authority must depend on additional useful local context and justify its cost.
The implemented election uses LLM judgments of candidate summaries and proposed phase objectives. It does not compute information gain or guarantee selection of the best-informed agent. We will clarify this distinction and use consistent notation for the incumbent and candidate coordinators.
The methodological distinction is joint phase-and-coordinator selection coupled to phase-local DAG authorship and progress continuity. We agree that low absolute success rates preclude a reliability claim; the evidence supports a conditional protocol comparison, not a guarantee that rotation causes success.