- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes FORM, a framework for differentiable morphology–control co-design of articulated rigid-body robots. It combines a continuous relaxation over a fixed kinematic supergraph with short-horizon differentiable simulation, and outperforms CMA-ES on a flat-ground locomotion task.
Critical strengths
- This work is well motivated. It provides a useful end-to-end differentiable pipeline. It connects morphology optimization and neural control through differentiable rigid-body simulation, enabling gradient-based optimization of both morphology and control.
- The physical modeling is well designed, including contact and friction dynamics, joint limits, and morphology-dependent actuation, with additional treatments to improve numerical stability.
- The experiments include comprehensive ablation studies and informative analyses.
Critical weaknesses
- The proposed method has limited structural flexibility. Its reliance on a predefined kinematic supergraph restricts the exploration of more complex topologies.
- Comparisons with existing gradient-based co-design methods are insufficient. Methods such as Transform2Act and BodyGen also optimize structural design through policy gradients, but are not included in the evaluation. Such comparisons would help establish FORM's advantages over existing approaches.
- The experimental evaluation is limited to a single flat-ground locomotion task. It remains unclear whether the observed improvements generalize beyond thissetting and how the method performs on more complex tasks.
Questions for authors
- FORM jointly optimizes limb presence, geometry, and attachment, while the presence parameter also affects actuation and observations. Could the authors provide more insight into how these different factors contribute to the evolved morphologies and performance? In particular, are the improvements mainly driven by changes in effective topology or by continuous adjustments to geometry and actuation?
- FORM adaptively increases the center fraction and ends with an all-center phase, whereas CMA-ES uses a fixed fraction of 0.125. With the same fixed fraction, FORM reaches only 1.37 (Fig. 5a), below CMA-ES’s 2.11 (Fig. 3). . Could the authors discuss how much of FORM’s advantage comes from this schedule rather than from the pathwise gradients?
7 comments
Response to Reviewer w5vv (Part 2/2)
Q1: FORM jointly optimizes limb presence, geometry, and attachment, while the presence parameter also affects actuation and observations. Could the authors provide more insight into how these different factors contribute to the evolved morphologies and performance? In particular, are the improvements mainly driven by changes in effective topology or by continuous adjustments to geometry and actuation?
In FORM, effective topology and geometry cannot be fully disentangled: geometric changes can alter ground contact even with fixed presence, while presence also affects limb geometry, actuation, and observations. Nevertheless, presence is most directly associated with limb deployment, whereas the remaining morphology parameters primarily control geometry and attachment. We therefore use two parameter-group ablations to better understand their contributions.
We have added Appx. I: “Morphology Parameter-Group Ablations” (Fig. 13), which reports:
We examine the contribution of different morphology parameter groups through two additional ablations. Fixed presence holds limb presence at its initial value while optimizing the remaining morphology parameters, whereas presence only optimizes presence while fixing the remaining morphology parameters. Across four matched seeds, full FORM achieves a mean best-so-far return of 4.55, compared with 0.97 and 0.41 for the two ablations, respectively (Fig. 13). These results highlight the benefit of jointly optimizing presence and the remaining morphology parameters.
Although these ablations cannot uniquely attribute the improvements to topology or geometry, they show that neither restricted variant approaches the performance of full FORM, supporting the benefit of their joint optimization.
Q2: FORM adaptively increases the center fraction and ends with an all-center phase, whereas CMA-ES uses a fixed fraction of 0.125. With the same fixed fraction, FORM reaches only 1.37 (Fig. 5a), below CMA-ES’s 2.11 (Fig. 3). . Could the authors discuss how much of FORM’s advantage comes from this schedule rather than from the pathwise gradients?
We apologize for the confusion. We realize now that our original submission did not clearly explain why we used a fixed center fraction for CMA-ES while FORM employed competence-based allocation. We have now clarified the motivation behind this design choice in Sect. 3.1.
Specifically, as stated in the revised manuscript:
Unlike FORM, which can continue optimizing morphology through pathwise gradients even when all environments use the same center design (), CMA-ES relies on evaluations of sampled candidate morphologies to update its search distribution. Without such evaluations, CMA-ES cannot continue optimizing morphology.
For a fair comparison that preserves CMA-ES's ability to optimize morphology throughout training, we therefore keep CMA-ES at FORM's initial center fraction of in the main comparison.
In other words, our intention was to allow CMA-ES to continue searching for better morphologies throughout training. We recognize that this was not clear in the original submission.
Nevertheless, we agree with the reviewer that center allocation itself can affect performance. To address this concern directly, we have added Appx. G: Effect of Center-Allocation Schedules (Fig. 11), which compares both methods under identical allocation rules.
As reported in Appx. G:
Across eight matched seeds, at a common wall-clock cutoff of hours (compared to hours in Fig. 3), FORM achieves higher mean best-so-far returns under both settings: versus with fixed allocation, and versus with competence-based allocation.
We would also like to clarify the difference from the earlier fixed-allocation ablation. The previously reported mean of 1.37 was based on four seeds (1000–1003). The four additional seeds (1004–1007) achieved substantially higher returns, bringing the eight-seed mean to 4.01, with all original runs retained. This highlights the substantial seed-to-seed variability of fixed-allocation FORM.
Importantly, FORM achieves a higher mean return under both matched allocation schedules. Even fixed-allocation FORM (4.01) exceeds CMA-ES with competence-based allocation (2.78). These results suggest that while center allocation contributes to FORM's performance, it does not alone explain its higher mean return.
We hope these results clarify the contribution of center allocation to FORM's observed performance advantage.
I thank the authors for their detailed response and additional experiments. I believe that making morphology–control co-design differentiable is a valuable direction for improving optimization efficiency. However, I still have concerns about the comparisons with BodyGen and Transform2Act. These methods were originally designed around their own topology construction mechanisms, rather than continuous optimization within a fixed supergraph. These approaches represent different ways of performing morphology–control co-design, and removing the original topology construction mechanisms may not fully reflect the capabilities and efficiency of these baselines. Since sample efficiency is a key claimed advantage of FORM, I believe the current comparisons do not fully establish its efficiency advantage over the original methods. I will therefore maintain my original score.
Response to Reviewer w5vv (Part 1/2)
We thank the reviewer for their thoughtful questions, constructive suggestions, and positive assessment of our motivation and contributions. We have conducted several additional experiments to address the reviewer’s comments and have revised the manuscript accordingly.
W1: The proposed method has limited structural flexibility. Its reliance on a predefined kinematic supergraph restricts the exploration of more complex topologies.
Although FORM performs optimization within a predefined candidate supergraph, it is not restricted to the six-appendage configuration used in our main experiments.
To demonstrate this flexibility, we have added Appx. K: Alternative Candidate Supergraphs (Figs. 15–17), where we extend FORM to different supergraph sizes and more complex branching structures. As described in the revised appendix:
We acknowledge that FORM does not dynamically add new nodes or edges during training. To clarify this distinction, we added the following discussion to Appx. K:
W2: Comparisons with existing gradient-based co-design methods are insufficient. Methods such as Transform2Act and BodyGen also optimize structural design through policy gradients, but are not included in the evaluation. Such comparisons would help establish FORM's advantages over existing approaches.
Understood. We have added comparisons with BodyGen and Transform2Act across eight matched initialization seeds (Sects. 3.1–3.2, Figs. 3 and 5).
As described in the revised Sect. 3.1:
We acknowledge that these adaptations omit the original methods' discrete topology-editing ability and therefore compare optimization within a shared candidate supergraph.
The revised Sect. 3.2 reports:
FORM achieves higher returns in all eight matched runs against each baseline (Figure 3C; (p=0.0078) for each paired comparison). Figure 5 further compares the selected morphologies.
We also explicitly acknowledge that:
W3: The experimental evaluation is limited to a single flat-ground locomotion task. It remains unclear whether the observed improvements generalize beyond this setting and how the method performs on more complex tasks.
To explore FORM beyond flat-ground locomotion, we have added a new Appx. L: “Preliminary stair-climbing experiment” (Fig. 19). We evaluate FORM in an environment with 16 ascending steps of 4 cm each, incorporating terrain-aware observations while retaining the original optimization procedure and training budget.
For convenience, we quote the key findings from the revised manuscript:
We view this preliminary stair-climbing experiment as an encouraging first step toward more complex, contact-rich tasks. Such environments pose challenges for gradient-based co-design, as the benefits of morphology changes may depend on future contact interactions that are difficult to capture with short-horizon gradients [1] . Building on these initial results, we aim to improve gradient guidance and extend FORM to more challenging tasks, including manipulation, in future work.
References:
[1] Luo, Jing Yuan, et al. (2025) ICRA. https://ieeexplore.ieee.org/document/11127448