- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an LLM based framework for jointly optimize robot morphology and reward functions. It designs a coarse-to-fine optimization strategy, including diversity reflection, morphology screening, and alternative optimization. Then the design is evaluated using SAC, an RL algorithm. Experiments on different robotics tasks demonstrate promising improvements.
Critical strengths
- Joint optimization of morphology and reward function can indeed find better solution than single optimization.
- This paper demonstrated the effect on different kinds of robots and provide good visualizations.
Critical weaknesses
- The description is a little misleading. In Figure 3, there is a . However, this paper does not actually calculate gradients. Instead, it simply asks the LLM to propose better parameters based on previous results. This is more like prompt engineering rather than a truly differentiable joint optimizer for morphology design and reward functions.
- Combining morphology optimization and reward function optimization seems relatively straightforward. The performance improvements are somewhat expected even without these experiments.
- Since existing works such as LASeR (LLM for morphology design) and Eureka (LLM for reward shaping) have already explored these directions, I feel this paper mainly combines these two approaches without introducing a significant methodological breakthrough.
Questions for authors
- What is the key methodological novelty beyond combining existing LLM-based design approaches?
- Could the authors compare against LASeR combined with Eureka?
- How are the proposed LLM "textual gradients" defined? Are they actual gradient estimates or simply heuristic proposals?