- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes EgoX, a cross-embodiment manipulation learning framework for heterogeneous robot and human demonstration data. The method achieves cross-embodiment joint pre-training and target task fine-tuning through a unified egocentric modal representation, a shared Transformer backbone, and embodiment-specific action experts. Additionally, the authors introduce Embodiment Dreaming, which enhances policy learning by predicting the future latent representations of the embodiment. The paper validates the approach on five categories of manipulation tasks across five real-world robots and one simulated robot, with experiments demonstrating that cross-embodiment pre-training and Embodiment Dreaming improve downstream manipulation performance.
Critical strengths
- The experimental coverage is extensive. The method is validated on five morphologically distinct real robots and one simulated robot, covering dexterous manipulation, tool use, and long-horizon tasks, providing broad empirical support for its effectiveness.
- Experiments demonstrate that jointly utilizing human and heterogeneous robot data improves downstream manipulation performance on target robots. Furthermore, Embodiment Dreaming yields additional gains in specific tasks, demonstrating the framework's practical value.
Critical weaknesses
- The methodological novelty is limited. EgoX primarily builds upon the existing MXT architecture. The proposed Embodiment Dreaming is essentially future latent prediction via an EMA Teacher, closely resembling existing predictive representation learning methods. Without direct comparisons to other temporal prediction auxiliary objectives, its unique technical contribution remains unjustified.
- The approach relies on a standard two-stage paradigm of cross-embodiment pre-training and target-task fine-tuning, failing to demonstrate that a unified policy can control multiple robots without fine-tuning. Furthermore, given the limited training data scale and the absence of systematic scaling experiments or standard simulation benchmark evaluations, the current evidence is insufficient to support its broad claims regarding general cross-embodiment learning.
Questions for authors
-
What is the unique contribution of Embodiment Dreaming compared to existing future latent prediction or JEPA-like auxiliary objectives? Are there comparative experiments with other auxiliary predictive objectives?
-
Can the pre-trained model directly control different robots without target-task fine-tuning, and what is the corresponding performance?
-
How does model performance change as training data volume, task variety, and embodiment diversity increase? Are there relevant scaling experiments?
-
Why was the method not evaluated on standard benchmarks like LIBERO or RoboCasa? How do the current experiments ensure a fair comparison with other cross-embodiment learning methods?