- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the asymmetric roles of the designer and controller in morphology–control co-design. The authors introduce three metrics, spread, exploration, and generalization, to analyze their optimization behaviors. Based on the findings, they propose SCOPER, which achieves improved final performance and wall-clock efficiency on a modular robot locomotion task.
Critical strengths
- The paper investigates an important question about the different optimization behaviors required by the designer and controller, offering a meaningful perspective beyond developing another co-design algorithm.
- The proposed metrics provide a useful framework for analyzing and comparing different co-design methods.
Critical weaknesses
- Efficiency comparison. SCOPER uses 201M environment samples, compared with 50M for BodyGen (Table 2). While SCOPER achieves better wall-clock efficiency, its advantages in sample efficiency are therefore unclear. It would also be helpful to better distinguish the algorithmic improvements from the benefits of its highly parallelized implementation.
- Limited task diversity. The experiments cover only one Modular Ant locomotion task. Different tasks may have very different morphology fitness landscapes, potentially changing the importance of designer spread and controller generalization.
Questions for authors
- The definition of in Eq. (5) may reflect differences in morphology potential in addition to controller generalization. For example, lower performance on an unfamiliar body could result from its lower potential rather than limited controller adaptation. Please correct me if I have misunderstood this metric.
- Eq. (6) uses the optimal response , assuming that the controller can optimally respond to every sampled design. How should this analysis be interpreted when the controller has limited adaptation ability?
- Could the authors provide visual comparisons of the morphologies discovered by SCOPER and baseline methods? In particular, showing representative designs at different training stages would help illustrate how their morphology search behaviors differ and whether BodyGen indeed converges prematurely.
2 comments
I thank the authors for their detailed response. Most of my concerns have been addressed, and I will maintain my positive rating.
Reviewer frE2 Response
We want to thank you for your time and constructive feedback on our paper.
@1) Interpretation of ρC
Your interpretation is correct. As detailed in Common Response C1, we now refer to ρC as controller competence transfer and clarify that it measures realised performance retention over each method's own morphology-search distribution, rather than morphology-independent controller ability. We additionally report a fixed-bank evaluation over the same 56 morphologies, using body-specific specialists as a common reference for cross-method comparison.
@2) Eq. (6) with limited controller adaptation
You are correct that Eq. (6) assumes the optimal design-conditioned response a∗(d), whereas practical controllers may not realise this response. We retain Eq. (6) to describe the structural value available from conditioning on the realised design, and add Eq. (7) to account explicitly for the shortfall of the controller available during optimisation.
When controller competence is limited, this shortfall offsets part of the value available through conditioning: a high-potential design can receive low realised fitness and therefore be passed over during selection. The commitment-gap experiment demonstrates this mechanism empirically: broader designer search discovers higher-potential designs, while stronger controller competence transfer narrows the gap between what is discovered and what is ultimately selected.
We therefore distinguish the structural result of Eq. (6) from the empirical sampling-breadth preference: EVPI explains why designer-side uncertainty can be more recoverable, while the controlled experiments determine when broader designer sampling is actually beneficial.
@3) Visually comparing SCOPER to the baselines
We add representative early, middle, and final committed morphologies for SCOPER, NGE, and BodyGen in App. D, Fig. 6, directly addressing your request.
Qualitatively, NGE trends toward simpler morphologies over training, BodyGen concentrates early on a stable morphology and changes little thereafter, while SCOPER continues to modify its morphology after initially finding a stable design. We present these visualisations as qualitative context for the optimisation profiles measured in the main experiments, rather than as evidence for a particular causal explanation from a single run.
We hope these clarifications and additional results address your concerns, and we would greatly appreciate your reconsideration of the paper's rating if so.