- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses causal, online human–scene reconstruction from monocular video by incorporating a joint-state-conditioned continuous velocity field into a recurrent visual reconstruction framework. The field connects joint positions, velocities, and accelerations through integration and differentiation along its predicted trajectory. Its motion estimates are fed back into the human representation before mesh regression, while joints extracted from the previous final mesh anchor the next transition. On EMDB-2 and RICH, the complete system improves world-space joint accuracy and several temporal metrics over the evaluated Human3R baseline.
Critical strengths
-
Incorporating higher-order dynamics into a human–scene reconstruction model is a well-motivated idea.
-
Velo3R performs well in terms of world-grounded human motion accuracy and temporal consistency, achieving state-of-the-art performance among online methods.
-
The paper is well written and easy to follow, with a clear presentation.
Critical weaknesses
-
The qualitative results are not compelling. Even upon zoom-in and careful inspection, it is still difficult to discern clear improvements over Human3R. In some cases, Velo3R appears noticeably worse than the Human3R baseline. For example, after repeatedly comparing the results for
05_twopersons_running, it is observed that Human3R produces better overall reconstruction quality, with smoother acceleration and less jitter. In11_basketball_practice, the main difference highlighted by the authors is an identity switch in Human3R, which is not the primary focus or claimed improvement of this work. Beyond this difference, Velo3R appears comparable to Human3R in scene reconstruction quality, motion quality, and human–scene alignment, including artifacts such as feet penetrating below the ground surface, with no discernible improvement. -
In Table 2, Velo3R consistently underperforms OnlineHMR in local pose accuracy, without sufficient analysis or explanation.
-
The experiments do not establish whether explicitly representing high-order motion quantities (velocity and acceleration) is more effective than learning them implicitly. For example, could comparable results be achieved by directly applying higher-order supervision to the Human3R baseline's human head during training?
-
The improvements attributable to some higher-order supervision terms are very small. In Table 5, velocity supervision alone achieves a W-MPJPE of 259.8 mm, while full position, velocity, and acceleration supervision achieves 259.6 mm. Adding acceleration supervision without position supervision instead increases W-MPJPE to 264.2 mm and W-Accel from 43.4 to 43.5. In Table A1, adding the bone term worsens all five reported metrics, including W-MPJPE from 265.9 to 266.2 mm and W-Jitter from 210.7 to 213.3. These results provide limited evidence that each constraint contributes a consistent benefit.
-
Despite presenting Velo3R as a unified human–scene reconstruction model, the paper does not provide results or evaluations specifically demonstrating the degree of alignment between the reconstructed humans and scenes. In light of related work such as UniSH and SHOW, it remains unclear whether Velo3R places the reconstructed scene and humans in a shared 3D space at a consistent scale, or whether the human meshes and scene point clouds are spatially aligned.
Questions for authors
See weaknesses.