- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an agentic framework for motion generation involving interactions among multiple characters and objects. By incorporating event specifications, history-guided search, and conditional reuse, the framework improves task success rates. In addition, the authors introduce a benchmark consisting of 300 tasks.
Critical strengths
The paper introduces a comprehensive benchmark, MotionCoordBench, consisting of 300 tasks, including 261 offline-generation tasks and 39 online-generation tasks. This benchmark could serve as a valuable resource for evaluating future agentic frameworks for human motion generation and coordination.
Critical weaknesses
-
Insufficient experiments. The main table only compares against direct generation, Codex and Pi. The ablation study shows that the proposed plan recombination brings only a marginal improvement. Most performance gains seem to come from the overall agentic framework, which is not entirely novel. Therefore, the core contribution is not sufficiently validated by the experiments.
-
Unclear contributions. Although the paper discusses many related studies, it does not clearly distinguish its contributions from existing agentic motion generation frameworks. The introduction and experiments seem to position MotionHarness as a pioneering agentic framework, without sufficiently clarifying what is fundamentally new compared to prior work.
Questions for authors
Belows are my major comments:
- I think the authors should clarify the unique contributions of MotionHarness more carefully. For example, the current title does not clearly highlight what distinguishes MotionHarness from existing work, as agentic spatiotemporal coordination has already been explored. The title could better emphasize the specific motivation or technical contributions, such as conditional reuse. The same concern applies to the first contribution listed at the end of the Introduction, since the paper itself has already discussed several related works addressing similar problems. I suggest that the authors reconsider the title and the presentation of their contributions to better highlight the novelty of this work.
- To my understanding, conditional reuse and related mechanisms are the main technical innovations of this paper. However, Table 3 shows that removing plan recombination only reduces ValidTaskSR by 1.9%. In contrast, Table 2 shows a substantial improvement of MotionHarness over direct generation with GPT-6 Astra. This suggests that much of the improvement may come from the overall agentic framework rather than the novel mechanisms proposed in this paper. I think this discrepancy deserves further discussion in Section 5.3.
- The paper does not provide sufficient analysis of how Codex searches and refines its solutions. Since Codex may already perform similar forms of historical decision reuse, it is important to investigate whether the proposed mechanism is fundamentally different from what existing agents can achieve.
- Comparing Section 3.4 and Appendix B.4, it seems that MotionHarness and Codex/Pi do not have access to the same feedback information. So I have concerns about the fairness of the comparison. Could the authors clarify whether the baselines receive equivalent feedback and, if not, explain why?
Belows are my minor comments:
- Since all modules are training-free, I think the proposed framework may not necessarily improve the upper bound of performance, but could improve exploration efficiency. Comparing methods under a limited token budget is a good approach. I suggest that the authors further plot success rate as a function of token budget to better demonstrate the advantages of the proposed method.