- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces Humanoids, a benchmark with synthetic RGB and robot-state annotations for 12 humanoid embodiments, plus real videos annotated with 2D keypoints. HumanoidPose estimates joint configurations and camera-relative root poses using frozen visual features, keypoint-conditioned queries, separate root prediction, and FK-based residual refinement. Models are trained separately for each robot. Evaluation reports improvements over adapted human/robot pose estimators on synthetic 3D metrics and real-image 2D metrics.
Critical strengths
- The benchmark pairs RGB with robot states across 12 embodiments and uses motion-disjoint splits. This provides a common setting for comparing humanoid pose estimators beyond individual robot platforms.
- The method improves synthetic MPJPE from approximately 75.6 mm for the strongest adapted baseline to 60.0 mm (Table 5). Component ablations support the usefulness of the proposed combination.
Critical weaknesses
- The methodological and dataset contributions appear incremental. Joint-angle and camera-relative pose estimation already appear in RoboPose (Labbe et al., 2021), while HoRoPose (Ban et al., 2024) already separates joint states, rotation and root depth. Section 4 does not clearly establish what new mechanism is required for humanoids beyond adapting these designs with keypoint-conditioned decoding and geometric refinement. Likewise, Humanoids-Sim uses existing AMASS motions, GMR and simulator rendering; related retargeting workflows are established in SONIC (Luo et al., 2026). Covering 12 robots broadens the benchmark, but each robot has a separate model. More controlled comparisons are needed to establish the contribution beyond this engineering adaptation.
- The evaluation leaves the real-world significance of the contribution uncertain. Humanoids-Real contains only 31.5 minutes across 12 embodiments, excludes severely occluded videos, and provides no metric 3D or joint-state ground truth (Section 3.2.2; Appendix B). Consequently, the central claim of recovering 3D robot states is validated only in simulation; improved 2D projection does not establish accurate depth or articulation.
- The synthetic training split is also limited to 5 h 19 min, with no data-scaling analysis to separate architectural gains from data limitations.
- No downstream experiment demonstrates whether the recovered states support the robot-learning or skill-transfer applications motivating the paper.
Questions for authors
- Do the adapted baselines use comparable visual features, 2D-keypoint inputs and training budgets? What evidence isolates the benefit of keypoint-conditioned queries and bounded refinement beyond a standard robot-state regressor with FK supervision?
- Is there any real-video joint-angle or metric 3D evaluation, or downstream validation showing that the recovered states are usable beyond matching 2D projections?
- How do the proposed method and the strongest adapted baseline compare as the number of source motions or rendered views increases? This would help assess both the dataset's contribution and the persistence of the reported method advantage.