- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper presents a dual-agent framework for designing terrain curricula and reward functions for mixed-terrain quadrupedal locomotion. One LLM agent generates terrain programs, while another proposes rewards conditioned on the terrain and feedback from the current policy. PPO training, within-arena reward screening, and gait-constrained cross-arena selection determine which policy is retained for the next round. Transition-frontier feedback summarizes the policy's competence boundary, frequent failure intervals, and associated statistics. The framework is evaluated on simulated Go1 locomotion, including a mixed-terrain benchmark, component-to-composition diagnostics, and fixed-policy tests on three public terrain suites.
Critical strengths
-
I get the motivation. Being able to cross individual obstacles does not necessarily mean a policy can handle them in sequence. Adjusting both the terrain and reward around the same failures is a reasonable direction, and the component-to-composition experiment makes the motivation more concrete.
-
The reported gains look good. The main benchmark reaches 82.5% success versus 62.5% for Eureka, and the fixed-policy tests on public terrain suites provide some evidence beyond the authors' own benchmark. The appendix also gives substantial detail about the design loop.
Critical weaknesses
-
I am still not sure why this needs two agents. What happens if one GPT generates both terrain and reward with the same feedback and budget? The pipeline currently feels more like task-specific LLM-guided search than a clearly established methodological advance. There may be a useful decomposition here, but the comparison needed to establish it is missing.
-
The ablations help, but they do not quite isolate the mechanisms emphasized in the paper. Removing all explicit feedback does not tell me whether transition-frontier diagnosis is better than ordinary progress feedback. Reward screening and cross-arena selection remain active, so their individual contributions are also unclear. With search, gait constraints, inheritance, and selection all affecting training, I find it hard to tell where the gain comes from.
Questions for authors
-
Why are two agents needed? How does a single agent that jointly generates terrain and reward perform under the same feedback, candidate count, and training budget?
-
Does transition-frontier feedback outperform ordinary success-rate or progress feedback? The current feedback ablation removes several kinds of information together.
-
What happens if policies are selected only on their own arena rather than across arenas? Can the contribution of within-arena screening also be separated from the rest of the search procedure?
-
How is the training budget kept comparable when reward candidates are reduced from eight to one in the no-reward-optimization ablation? Are additional trained batches and failed runs included in the reported budget?
Thank you for the additional experiments and clarifications. My concerns about final policy evaluation and budget fairness are addressed.
However, I am still concerned that the methodological contribution beyond Eurekaverse is incremental. The results support the full framework. However, the clear and big gains of the proposed method are achieved on the authors' mixed-terrain benchmark. On the public benchmarks the results are still competitive but show smaller and less consistent improvements.
In my opinion, clear evidence that specifically the added algorithmic changes lead to benefits is missing. The effects of the particular coordination and selection choices are insufficiently isolated. Therefore, it is hard to asses if the extensions lead to a substantial methodological advance.
I maintain my weak-rejection recommendation.