- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates a data-level approach to cross-embodiment transfer by evaluating the performance gains achieved through aligning source-embodiment data with target-embodiment data. Specifically, the authors examine four key aspects of data alignment: end-effector frames, arm configurations, proprioceptive states, and camera viewpoints. The first two focus on matching the source embodiment to the target, whereas the latter two aim to mitigate discrepancies in observations between embodiments. Results from both real-world and simulation experiments demonstrate that such data alignment facilitates effective transfer of manipulation skills and object recognition capabilities. Furthermore, this work conducts controlled ablation studies to systematically assess the contribution of each alignment factor to cross-embodiment transfer between two distinct robotic platforms (Moz-1 and Franka).
Critical strengths
- While many existing approaches to cross-embodiment learning focus on model-level adaptations, this work explores a complementary data-centric perspective. By applying relatively simple modifications to the source data, the proposed strategy substantially improves the cross-embodiment transfer performance, as shown in Figure 5 and Section 4.2.
- The experimental results in Figure 5 also provide a comparison with the HPT-style baseline, and its relatively low performance suggests that model-level adaptations alone may not sufficiently address the inherent problem of data compatibility.
- The experiment design incorporates diverse embodiments (Section 4.1.1) for the cross-embodiment transfer, pointing to the potential scalability of the proposed approach to a larger number of embodiments.
Critical weaknesses
- The arm-configuration alignment strategy based on arm activity (Section 3.3) seems heuristic and raises questions about its applicability to more diverse task setups (e.g., what if both arms exhibit similar levels of activity, or the less active arm plays an important role in manipulation?). Although the authors acknowledge that the less active arm may provide essential support in Section 3.3, it remains unclear how well this strategy generalizes to more complex bimanual behaviors. Furthermore, Appendix E discusses the different effects of alignment on complex manipulation tasks, but does not clearly isolate the limitations of this particular strategy.
- The object-recognition transfer evaluation (Section 4.1.2) seems somewhat indirect in demonstrating the improvement of object-recognition capabilities. Since success is measured by whether the robot moves toward the correct object and attempts to grasp it, it is unclear whether the performance gain comes from improved object recognition or better action prediction due to data alignment. Further analysis of how the proposed alignment affects the object representations learned by the VLM would help clarify whether the improvement is associated with improved visual understanding rather than primarily better action prediction.
Questions for authors
- How does the proposed arm-configuration alignment strategy handle tasks where both arms exhibit similar levels of activity or where the less active arm plays an important role in manipulation? Could the authors provide further analysis of the limitations of this heuristic on more complex bimanual tasks?
- The results in Figure 5 show a substantial performance gap between the proposed alignment strategy and the HPT-style baseline. Have the authors considered combining data-level alignment with the HPT-style approach to investigate whether these two strategies provide complementary benefits?
- Could the authors provide further analysis of whether the improvement in object-recognition transfer comes from improved visual representations or better action prediction? For example, would it be possible to examine how the learned object representations differ between naive data mixing and aligned data mixing?
2 comments
Invitation for Discussion
Dear Reviewer trEg,
We would greatly appreciate it if you could take a moment to review our response and let us know whether our responses have addressed your concerns. We would be happy to provide any further clarification.
Thank you for your time and consideration.
Response to Reviewer trEg
Thank you for recognizing the value of our data-centric approach, the substantial improvements in cross-embodiment transfer, and the diversity of our experimental embodiments. We appreciate your constructive suggestions regarding arm-configuration alignment, object-recognition transfer, and the complementarity with model-centric methods, and address them point by point below.
Weakness 1 & Question 1: Scope and limitations of activity-based arm selection. We clarified the scope and limitations of activity-based arm selection and explained why this strategy does not affect our main experimental results.
We clarify that the activity-based arm selection is only applied when transferring bimanual demonstrations to a single-arm robot. Since a single-arm robot executes actions through a fixed working-arm slot, we adopt this heuristic during training to retain the more active arm from each action chunk. Tasks that inherently require simultaneous coordination of two arms are beyond the capabilities of a single-arm robot, so this transfer necessarily involves a trade-off. Table 3 validates this design, showing that masking the less active arm outperforms random masking and no arm-configuration alignment.
Importantly, our main results in Figure 5 and Appendix E do not rely on this heuristic, as Moz-1 is a bimanual target. Bimanual-to-bimanual transfer preserves both arms, while single-arm-to-bimanual transfer simply pads an idle arm. Therefore, the concern regarding activity-based arm selection does not affect our main cross-embodiment transfer results.
Weakness 2& Question 3: Visual representations. We conducted additional linear probing experiments.
To distinguish improvements in visual representations from those in action prediction, we conduct an additional linear probing experiment. We use the five objects exclusive to the DROID dataset as listed in Figure 4 and collect 40 visual observations per object in the Franka robot setup, yielding 200 samples. Using "Pick up the object" as the text instruction, we extract the VLM output embeddings from the Naive Data Mixing and Aligned Data Mixing policies. We train linear classifiers on 150 samples and evaluate them on the remaining 50.
The classification accuracies are 60% for Naive Data Mixing and 64% for Aligned Data Mixing, showing no substantial difference in the linear separability of their learned object representations. This suggests that the gains in object-recognition transfer are more likely driven by better action learning in the action expert rather than differences in visual representations.
To illustrate, given the same spatial relationship between the robot and an object, the robot should move in the same physical direction to approach it. However, without alignment, this movement may correspond to a positive action value in one embodiment but a negative value in another. Such conflicting supervision can confuse the action expert, even when the VLM correctly identifies the object.
Question 2: Complementarity between data-level alignment and HPT modeling. We conducted additional experiments to evaluate the complementarity of data-centric alignment and the model-centric approach.
As discussed in Section 4.1.3, data-level alignment and model-centric methods, represented by HPT, are not in conflict. To investigate their complementarity, we conduct an additional experiment combining HPT with our aligned data mixing strategy. On the 21 source-only skills, HPT + Aligned Data achieves a success rate of 94.3%, compared with 90.5% for Aligned Data Mixing alone in Figure 5. This further improvement demonstrates that data-level alignment can complement model-centric approaches to achieve stronger cross-embodiment transfer.
Thank you again for your feedback. We hope these clarifications address your concerns and encourage you to reconsider the overall contribution of this paper. We will update the manuscript after the discussion, incorporating all of the feedback received.