- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Volumetric Morphology Encodings, which uses a pretrained 3D convolutional autoencoder to encode robot geometry into compact morphology representations for universal control. These embeddings replace hand-crafted descriptors in existing RL policies. Experiments on UNIMAL demonstrate improved control performance, particularly on challenging tasks, and better zero-shot generalization to unseen robot morphologies.
Critical strengths
- the idea is straightforward and the research question is importnat for crossembodiement robot learning.
- the method is novel and easy to understand.
- the improvement over the baselines is substantial
Critical weaknesses
- the task only compare with locomotion tasks, however, it is unclear how this can genearlize to other types of tasks like manipulation.
- the baselines compared here is very limited to robot morphology representation. It is important to compare with different way s of encoding the robot like urdf / grasphs.
Questions for authors
N/A
Thank you for finding the question important, the method novel and the improvement substantial. Both of your concerns point to places where the paper should be clearer. In our revision, all changes are in blue.
W1: Only locomotion; what about manipulation? The paper does include a manipulation task. MVT (Manipulation in Variable Terrain) requires the robot to reach an object and push it t o a goal over uneven terrain. It was proposed with UNIMAL (Gupta et al., 2021) but dropped by later online UC work. VME's largest relative gains are on MVT. On UNIMAL (Fig. 4), success improves by +45% (+66%) over ModuMorph MVT (MVT(θ)) and by +15% (+53%) over MetaMorph MVT (MVT(θ)). On Mesh-UNIMAL (Fig. 8), the improvement is +179% and +341%. MVT success is sparse and varies between seeds, so no single MVT comparison against D+K is significant at 5 seeds. However, all four favour VME. And quantitatively, VME policies learn to "kick" the object (Fig. 7, App. B.2.1).
As for R_test, all methods are near zero, so we do not claim that the manipulation gains transfer to unseen morphologies.
We note that online UC over hundreds of morphologies has so far been studied almost only on locomotion. Manipulation with robot arms and grasping at this diversity would need a new benchmark and new methods, since grasp representations (UniGrasp, AdaGrasp, GET-Zero) consider a very limited number of robot gripper finger count (far from the |M|=200 afforded by UNIMAL).
W2: Compare with URDF / graph encodings. Thank you for this comment. We acknowledge that we were unclear in our baseline definitions. We will make this more explicit in our revision.
body_parent. As for GNN-based online UC (NerveNet, SMP), this approach has been superseded by transformer-based online UC (Kurin et al., 2021; Gupta et al., 2022), which is why we build on the latter. But we note that VME is also graph-aware: a voxel grid is a regular graph over 3D space, and each VME token encodes its limb's joint region and the rest of the body, so connectivity is part of the learned representation. On ModularRL, the benchmark that was commonly used in the era of GNN-based online UC (App. B.3), VME gains +22.6% (+14.9%) over ModuMorph (MetaMorph) in the hard target-velocity regime and matches them on the easy one.We hope that this clarifies our experiments. If so, we would be grateful if you would consider raising your score, and we thank you again for your review.