- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces SEGUE, a framework that combines long-term coordination guidance from the symbolic solver VSI with decentralized LLM-based action selection and program execution. Agents can revise recommendations based on local constraints and use realized execution outcomes to update subsequent plans. The authors also introduce ESD-Bench, a Minecraft Cleanup benchmark, and report improved social welfare and execution reliability in selected settings. However, evaluation is limited to a single task with two agents, and the methodological contribution primarily involves integrating existing components.
Critical strengths
- The paper addresses failures that can arise when symbolic coordination policies are executed in an environment. Agents can adjust recommendations to local constraints and update subsequent plans using actual execution outcomes.
- The evaluation tracks action choices, requested and completed quantities, and resource transitions, helping distinguish poor coordination from execution failures. Controlled experiments and ablations also help assess the contribution of VSI guidance.
Critical weaknesses
- The paper motivates SEGUE through the symbolic-to-embodied deployment gap, but the evaluation does not sufficiently capture embodied complexity. It considers only a single task with a primarily text-based planning interface, providing limited evidence on embodied challenges such as multimodal perception, spatial reasoning, and recovery from physical execution failures.
- The evaluation is limited to a single Cleanup task with two agents. Variations in initial resource levels and action availability do not introduce substantially different coordination problems. This narrow scope makes it difficult to assess whether the method’s benefits extend to other social dilemmas, task structures, or larger teams.
Questions for authors
- What information is included in each agent’s local observation? Are spatial information and reachability provided by the environment interface, or must agents infer them?
- Is there evidence that SEGUE’s benefits extend beyond the two-agent Cleanup setting, particularly to tasks with different coordination structures or larger teams?