- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
WildHSR reconstructs metric humans, scenes, and camera trajectories from monocular video while maintaining person identities. It combines human-derived scale pseudo-labels, lightweight adaptation of a 3D foundation model, pelvis-based human-scene fusion, and temporal association using intermediate Q/K features. The reconstruction results are strong, particularly on EMDB-2, but the contribution of the identity mechanism to the final system remains insufficiently established.
Critical strengths
-
Strong reconstruction results. The method achieves 66.3 mm WA-MPJPE and 0.9% RTE on EMDB-2 (Table 1), outperforming the methods listed on these metrics. The 3DPW results also indicate competitive local body accuracy (Table 4).
-
Convincing evidence for scale pretraining. Turning approximate body measurements into offline supervision is a practical way to exploit unlabeled video without running the teachers at inference. Table 3 provides meaningful support: removing ITW pretraining increases WA-MPJPE from 66.3 to 116.3 mm and RTE from 0.9% to 3.7%, despite retaining exact metric fine-tuning.
-
Interesting correspondence analysis. Figures 2 and 5 provide evidence that intermediate features of the pretrained geometry model retain correspondence information for moving people. This is a useful observation that motivates reusing the backbone for association.
Critical weaknesses
-
The final-system benefit of the identity readout is unclear. Table 5 evaluates association components rather than the final end-to-end pipeline, as acknowledged in the text. It also labels the motion/confidence baseline as DP, leaving unclear whether the association backend is held fixed across variants. The combined method has lower IDF1 than Human3R [Chen et al., ICLR 2026] (82.1 vs. 87.4), despite substantially fewer aggregate ID switches. Since identity readout is a central contribution, a controlled comparison within the final pipeline is needed: keep proposals, training budget, and association backend fixed, and compare no identity features, early/image features, and intermediate Q/K features. Reporting IDF1/HOTA and per-sequence results would establish where the proposed representation helps.
-
Essential training details and contribution attribution remain incomplete. Section 3.5 lists the loss categories without fully specifying the combined objective, loss weights, or the contact term's construction and gradient flow. The provided adapter and readout settings are helpful, but the Pelvis Readout/fusion configuration and stage-specific training schedule also need clarification. In particular, Table 3 establishes the value of the training curriculum, while leaving unclear which modules are updated in each stage. A compact specification of the objectives, module configurations, and trainable modules/data/steps per stage would make the method reproducible and clarify the source of its gains.
Questions for authors
See weaknesses.