- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
GroundedHuman reconstructs human motion, scene geometry, and camera motion from monocular video in a shared metric frame. Starting from frozen VGGT-Ω and NLF estimators, it calibrates scene depth and camera translation through body-aligned scene queries. It then uses hierarchical regional context to refine human root translation while preserving pose and shape. Evaluation covers global motion, metric depth, human–scene consistency, and physical-grounding diagnostics.
Critical strengths
Strength 1: The complete system reports strong global-motion results.
On EMDB-2, it achieves 58.5 mm WA-MPJPE and 150.0 mm W-MPJPE, compared with 68.9 mm and 174.7 mm for JOSH (Table 1). These results demonstrate practical value for reconstructing humans and their surroundings together.
Strength 2: The grounding module provides measurable improvements within the proposed pipeline.
With calibration retained, adding grounding reduces the collision ratio from 12.83% to 6.48% and mean penetration from 4.65 cm to 2.89 cm (Table 3). The component ablations also support recomputing context after updates and separating human and environmental evidence.
Critical weaknesses
Weakness 1: The methodological advance over existing geometric-feedback methods is not sufficiently established.
GRAFT already uses body-anchored scene queries and recurrent corrective updates without explicit contact losses (Pradyumna et al., 2026, Secs. 3.2–3.3). The shared video calibration and hierarchical translation refinement are plausible extensions, but their added value remains unclear. There is no matched-initialization comparison with GRAFT or a comparable geometric refinement. Every variant in Table 3 retains calibration. The world-motion and metric-depth evaluations also lack a baseline using the same frozen estimators with only analytic scale alignment. Consequently, the reported gains do not adequately separate the contributions of the initial estimators, learned calibration, and proposed refinement.
Weakness 2: The physical evaluation does not adequately support the broader interaction claims.
HS-CF and HS-V measure agreement between the body mesh and scene-depth points on its visible surface (App. A.3). They do not evaluate contact with surrounding objects. The physical diagnostics use the lowest body vertex relative to an estimated ground height (App. A.4). They therefore cannot establish improvements in the sofa, seat, and backrest interactions emphasized in Fig. 5. Table 3 contains only internal ablations, without a quantitative physical-grounding comparison against contact-aware methods. The qualitative examples are useful, but insufficient to establish the claimed advantage over prior methods.
Questions for authors
Question 1 (Contribution attribution): With VGGT-Ω and NLF fixed, what are the global-motion and metric-depth results for analytic calibration alone, learned calibration, and the full model?
Question 2 (Interaction evidence): Can the authors provide quantitative scene-contact or penetration comparisons against UniCon3R and a GRAFT-based refinement using matched initial geometry? This would directly address the claimed improvement in interaction quality.
Question 3 (Training clarification): Which EMDB and 3DPW sequences are used for fine-tuning in Appendix B.3? Please specify the training and evaluation splits and confirm whether the evaluation sequences are held out.