- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents StereoHOI, a framework for metric hand–object reconstruction from egocentric stereo video. It combines frozen monocular hand priors with cross-view attention to estimate metric hand geometry. Stereo-based object reconstruction and separate trajectory optimization place hands and objects in a shared coordinate frame, improving reconstruction accuracy on the HOT3D benchmark.
Critical strengths
- Practical and well-motivated setting. Leveraging calibrated stereo cameras addresses the depth and scale ambiguities that complicate monocular hand–object reconstruction, which is a practical engineering solution.
- Effective stereo hand reconstruction. Comparisons with stereo baselines and input-view ablations support the method’s ability to improve both the hand and object.
Critical weaknesses
- Physical plausibility is insufficiently enforced and evaluated. Hand and object trajectories are optimized independently, without explicit contact or interpenetration constraints. A shared metric coordinate frame reduces scale inconsistencies but does not guarantee correct contact or prevent penetration and floating. For evaluation, hand-relative Chamfer Distance and qualitative examples provide limited evidence; direct measurements of contact error, penetration, and separation are needed to show the claimed interaction quality.
- Generalization across stereo configurations remains untested. The model is trained on Aria and Quest 3 but evaluated only on Aria. Testing on unseen camera configurations, stereo baselines, and focal lengths is needed to establish whether its metric reconstruction capability generalizes beyond the training setups.
- The full HOI comparison does not control for input differences. Although Table 1 includes stereo hand baselines, the HOI methods in Table 2 primarily use monocular video, whereas StereoHOI exploits stereo cues for hand localization, object scaling, and tracking. These results therefore do not separate the proposed method’s contribution from the benefit of additional depth information. Full-pipeline comparisons under matched stereo inputs are needed.
Questions for authors
- How does the current framework ensure physical plausibility?
- How about the generalizability to in-the-wild videos?
- Full-pipeline comparisons under matched stereo inputs?