- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper presents BeyondRetarget, a framework that directly predicts humanoid robot motion from monocular human videos without an explicit human-motion intermediate at inference. It learns a shared motion representation using morphology-aware geometric supervision and adapts to different robots through robot-specific output branches. Contact-aware refinement improves motion consistency and foot support. Experiments across multiple humanoid embodiments, including simulation and real-robot execution, demonstrate competitive motion quality and efficient inference compared with two-stage reconstruction-and-retargeting pipelines.
Critical strengths
-
The motivation and problem: learning executable motions from human videos for humanoid robots is crucial and the proposed solution via end-to-end training is promising.
-
The main experiment demonstrates persuasive improvement comparing with two-stage baselines, while the extended evaluation in appendix shows competitive cross-dataset performance.
-
The shared motion representation and robot-specific output branches enable efficient adaptation to different humanoid embodiments, with experiments on eight robots supporting the flexibility of the approach.
Critical weaknesses
-
Although the evaluation seems fair, could the authors clarify whether the two-stage baselines were adapted to MotionPRO and discuss how differences in training distributions may affect the observed improvements? Addressing the generalization limitations of these baselines is not necessary, but this clarification would help interpret the performance gap.
-
The in-the-wild examples and cross-dataset evaluation are encouraging. Could the authors discuss the data and annotation requirements for extending training to web videos, particularly how human-motion and contact supervision could be obtained? The cost of such expansion is relevant to the framework’s scalability.
Questions for authors
See Weaknesses.