- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes FlowEgoMotion, an egocentric full-body motion estimation method based on scene-conditioned Rectified Flow. The method integrates SLAM trajectories, local geometry, and global scene information to reconstruct human motion. Experiments on Nymeria and ADT demonstrate improved motion reconstruction accuracy and more plausible ground contact, while enabling efficient inference through a two-step Rectified Flow process.
Critical strengths
- Efficient inference. Compared with conventional diffusion-based methods, the proposed rectified-flow framework significantly reduces the number of sampling steps required for motion generation.
- Comprehensive experimental evaluation. Extensive quantitative experiments demonstrate the effectiveness of the proposed framework.
Critical weaknesses
- Concerns about reconstruction quality. In the demo videos, some reconstructed poses do not appear to match the input observations, raising concerns about reconstruction quality. The visualized scene point clouds lack clear geometric details. For example, in the pillow-hugging sequence, the pillow boundaries remain difficult to distinguish even when zoomed in, making it hard to evaluate human–object contact. Furthermore, the reconstructed motions appear to exhibit noticeable jitter and foot sliding. Although the authors emphasize accurate foot grounding, the visualizations do not clearly show foot–ground contact.
- More comprehensive demo videos covering a wider range of scenes are needed. The current 4D visualizations are insufficient to assess reconstruction quality, particularly temporal consistency, human–scene contact, foot penetration, and wrist localization accuracy.
- Figure 3 only compares the reconstructed human poses, without showing the baseline reconstructions in the corresponding 3D scenes for evaluating human–scene alignment.
- Although the paper emphasizes wrist localization and foot grounding, the qualitative results lack detailed visualizations of human–scene contact.
Questions for authors
- Given that HMD² and FlowEgoMotion use different test splits and skeleton conventions, why not provide a more direct comparison on identical test sequences? To what extent can the reported improvements be attributed to the proposed method rather than differences in evaluation protocols or scene representations?
- Does scene conditioning actually improve human–scene interactions? The paper highlights scenarios such as sitting on a sofa, descending stairs, bending toward a table, and navigating cluttered environments. However, the quantitative evaluation mainly relies on MPJPE, PA-MPJPE, Wrist-PE, and Floor Pen, while the qualitative results make it difficult to assess actual contact and interactions. Could the authors provide more detailed evaluations of human–scene contact consistency, such as sitting on furniture, avoiding obstacles, and reaching toward object surfaces?