- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
InterGuide learns physics-based humanoid loco-manipulation from imperfect monocular human–object interaction videos. It constructs coarse grasp hypotheses and accessible surface anchors from object geometry, then uses them for contact refinement, interaction-preserving retargeting, and phase-dependent hand rewards and termination. The pipeline requires annotated contact intervals, with optional grasp-center corrections and finger-side labels. Experiments include six non-grasp BEHAVE sequences and 25 self-captured grasping sequences. InterGuide improves contact-localization and geometric grasp-quality metrics over InterMimic and a GRAIL-inspired reward variant. Ablations examine orientation guidance and geometry-based termination, with additional comparisons of single- and multi-sequence training. All control evaluations are in simulation.
Critical strengths
The reported grasp-quality improvements are substantial across the four evaluated grasping categories.
Critical weaknesses
The methodological contribution is not sufficiently established. The complete pipeline improves the reported results, but the experiments do not isolate the benefit of the proposed geometry over simpler changes to the imitation framework, particularly relaxing unreliable finger tracking.
The evaluation does not yet establish reliable functional interaction from imperfect video references. Improved geometric scores on the selected sequences are promising, but their relationship to repeatable, effective grasping remains insufficiently verified.
Questions for authors
What accounts for the improvement over InterMimic? Beyond the shared architecture and pretrained weights, do all methods use the same reference preprocessing, reset strategy, hand joint limits, and simulation parameters? Please specify the relaxed tracking reward. The most informative additional control would be InterMimic with the same finger-tracking relaxation and initialization. Please also describe the source and scope of the category-level “clean RL replay data.”
How are evaluation rollouts executed and selected? Appendix B.1 reports the best retained rollout per sequence. How many rollouts and checkpoints were considered? Are geometry-based termination rules active during testing, and are execution termination conditions identical across methods? Please distinguish these from the success definition.
How were the sequences selected? The appendix excludes harder BEHAVE sequences because of additional contact segments, scale errors, and initial collisions. Were the evaluation sets fixed before running the methods? How many distinct object instances, participants, and environments are represented in the self-captured set, and how was the six-sequence chair ablation subset chosen?
How independent are the reconstruction targets, and how much manual intervention is needed? How often were inferred grasp centers corrected, by how much, and at what annotation cost? Were evaluation points annotated independently of the automatic suggestions? Table 1 measures contact localization rather than object shape, scale, or pose accuracy. Please clarify its reconstruction claims, why Trashbin is absent, and which categories and valid segments contribute to “All.”
What evidence supports the individual geometric components? Sparse surface anchors are evaluated through downstream non-grasp imitation, but their reconstruction benefit is not measured directly. Ordinal depth and scale adaptation are also not isolated. Please distinguish demonstrated benefits from plausible design motivations. Interaction-preserving retargeting, listed as a main contribution, would benefit from a small quantitative ablation. Finally, which training terms still use the reconstructed finger articulation after tracking relaxation? Is accurate finger reconstruction necessary, or could a mean-pose reference suffice?
Do the grasp-score gains translate into better execution? Contact preservation does not identify contact with the manipulated object. A target-object-specific contact or functional manipulation measure would therefore be useful. Please discuss the increased chair body/object errors and the table completion-rate decrease. Since errors use executed frames, could unequal temporal coverage contribute to the 1.05 cm object error for Chair InterGuideB? When alternative grasps are permitted, is the objective faithful hand-motion imitation or synthesis of a feasible substitute?
How should the baselines and ablations be interpreted? RGrailHand changes the reward aggregation and geometric measurements relative to GRAIL, so it should remain clearly identified as an adapted baseline. Its proximity reward barely changes GProxi on chairs and tables; could you explain this category-dependent behavior? In the w/o ROrient ablation, were palm-direction termination checks retained, and how often did they trigger?
Please clarify the contribution relative to RePHO (physical refinement), OmniRetarget (interaction-preserving retargeting), PHOSA (depth/scale reasoning), and HDMI, DeVI, VideoManip, and HOWTransfer (video-to-robot transfer). GPD, D-Grasp, Omnigrasp, ManipTrans, and DexMachina also provide context for grasp generation and dexterous control. Please distinguish their task assumptions; comparisons with every method are not expected. Finally, separate the demonstrated per-sequence results from the broader scaling motivation.