- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates how robot appearance and physical morphology affect the transfer of frozen visuomotor policies. It introduces a strict 2x2 simulator design that independently assigns collision and visual geometry, identifies mediation contrasts under explicit assumptions, and estimates a local exchange rate between material appearance and kinematic changes.
Critical strengths
-
The research question is very relevant. Understanding whether transfer failures arise from visual differences or changes in physical execution can inform the choice of adaptation methods.
-
The statistical design contains thoughtful elements. Paired scene seeds, uncertainty at the skeleton level, Fieller sets for slope ratios, and equivalence margins are appropriate choices in principle. The reported architecture and second-simulator experiments also broaden the evidence.
Critical weaknesses
- The study is conducted entirely in simulation and assumes a fixed action and proprioceptive interface across embodiments. While this controlled setting is well motivated for isolating appearance and kinematic effects, it remains unclear whether the measured trade-off and the resulting conclusions generalize to real-world cross-embodiment transfer, where robots may differ simultaneously in control interfaces, sensing, dynamics, and other factors.
Questions for authors
-
How are the logit coefficients in Equation 19 converted into the percentage-point predictions in Equation 21? Please provide the fitted coefficients, relevant operating-point probabilities, and the calculation producing the 5.0% boundary.
-
Could the authors provide visualizations or qualitative examples of failure cases? Such examples would be helpful for understanding how appearance and kinematic differences lead to policy failures in practice.
2 comments
Response to Authors' Rebuttal
I have read the authors' response and the other reviewers' comments, and revisited the paper. I acknowledge the motivation for using simulation to isolate appearance and kinematic effects. However, this setting inherently limits our ability to assess whether the findings hold on real robots, which is particularly important for robot learning. Therefore, I will maintain my original rating.
We thank the reviewer for recognizing the relevance of our research question and the rigor of our experimental and statistical design. We clarify the scope of our findings and address the two technical questions below.
1. Generalization to real-world transfer. Our study deliberately fixes the action and proprioceptive interfaces to isolate appearance and kinematic effects without introducing additional confounding factors. This controlled setting is essential for identifying the proposed causal contrasts. Our conclusions concern transfer sensitivity within this explicitly defined intervention space, rather than unrestricted transfer across heterogeneous robot systems. The architecture and second-simulator experiments provide additional evidence of robustness under controlled conditions. Real-world validation involving heterogeneous control interfaces, sensing modalities, and dynamics remains an important direction for future work.
2. Logit coefficients and the 5.0% boundary. Eq. (19) estimates success probabilities using a logit link, whereas Eq. (21) predicts residual gaps in percentage points. Specifically, given the success probability p0 at the operating point, the kinematic sensitivity slope is converted to the percentage-point scale as:
βppkin=100p0(1−p0)(βkin+η2τ~)
where η2τ~ represents the interaction with contact precision.
For appearance randomization covering both material and silhouette variations, the remaining predicted transfer loss is attributable to kinematic changes. Under the prespecified tolerance threshold of 5 percentage points, the boundary is calculated as:
dboundarykin=∣βppkin∣5
The reported boundary is approximately 5.0% of link length. We will provide the fitted coefficients, predicted success probability at the operating point, and explicit numerical substitution in the revised manuscript to make this calculation fully reproducible.
3. Qualitative failure cases. We will add representative policy failure cases in the revised manuscript to visually illustrate how appearance and kinematic differences affect policy behavior and task success.