- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Ray-Flow HMR models monocular human mesh recovery through a flow over 2D keypoints, a conditional flow over depths along camera rays, and a deterministic IK decoder producing SMPL parameters. Reprojection consistency is exact for intermediate joints and approximate for final meshes. Training combines BEDLAM with selective real-image supervision. Experiments on 3DPW and EMDB1 assess accuracy, reprojection consistency, and diversity, alongside a supervision ablation and uncertainty-guided view selection.
Critical strengths
-
A useful geometric formulation. Separating 2D localization from depth ambiguity guarantees intermediate reprojection consistency. The sampled-IK objective encourages the final meshes to preserve this property while retaining variation.
-
Promising empirical results. On EMDB1 (Table 1), the huge variant improves over HuMR in point/best-of-100 PA-MPJPE (51.33/37.09 versus 56.10/40.90 mm) and sample reprojection error (4.80 versus 5.68 pixels). It also improves consistency on 3DPW, while view selection illustrates a practical use of the predicted uncertainty.
Critical weaknesses
-
The benefit of ray-depth sampling is not isolated experimentally. Table 2 studies real-data supervision, but does not compare ray-depth sampling against direct 3D-joint prediction under otherwise matched conditions, including the backbone, training data, supervision, camera inputs, and IK decoder. The reported results support the overall system, but do not sufficiently isolate the contribution of its central parameterization.
-
Preservation of the geometric constraint through IK is not directly quantified. The exact reprojection guarantee holds for intermediate joints. The authors acknowledge that decoded SMPL joints can leave their rays and state that the deviation is small, but do not quantify it. Final reprojection errors are encouraging, yet do not isolate the displacement from the sampled 2D keypoints or changes in sample diversity caused by IK. This leaves a central link between the method's geometric motivation and its final outputs insufficiently validated.
Questions for authors
-
What is the specific advance over prior work? Chen et al. (CVPR 2019), Section 3.1 and Equation (2) and ElePose (CVPR 2022), Equation (2) already reconstruct joints through depth prediction and perspective unprojection, while HuMR (WACV 2025) uses 2D uncertainty for probabilistic mesh recovery. Please clarify what your two-stage conditional distributions and IK integration add beyond these approaches, distinguishing the new probabilistic formulation from the established ray geometry.
-
Can you isolate the benefit of ray-depth sampling? Please provide a controlled comparison against direct 3D-joint prediction with the same backbone, training data, supervision, camera inputs, and IK decoder. Reporting final-mesh accuracy, reprojection error, and diversity would help determine whether the proposed parameterization explains the gains.
-
How much does IK decoding affect ray consistency and sample diversity? The exact reprojection guarantee applies only to the intermediate 3D joints. Please quantify the final SMPL joints' reprojection deviation from the sampled 2D keypoints and compare 3D sample diversity before and after IK, particularly for occluded joints. This would clarify how much of the geometric consistency and predicted uncertainty is preserved in the final meshes.
3 comments
Thanks for running the additional experiments! The 2D + Cartesian flow baseline in G3 addresses my ablation concern by retaining the same 2D conditioning while testing the effect of the ray constraint. G4 also answers my question by measuring how far the final joint projections move from the sampled 2D keypoints and how much sample diversity is retained after IK. So I am raising my rating to 3 (Weak acceptance).
Thank you
We thank the reviewer for engaging with our response and for raising their rating. We are encouraged by the feedback, and grateful for the time spent reviewing our work.
Response to reviewer cGPw
We thank the reviewer for the review, and for finding the geometric formulation useful and the results promising. Concerns shared with other reviewers are answered in the general response; we refer to it below and address the remaining points directly.
W1, Q2: Isolating ray-depth sampling
See General Response G3.
We add an ablation with Cartesian flow models. Ray-depth parameterisation outperforms Cartesian models.
W2, Q3: Effect of IK on consistency and diversity
See General Response G4.
We analyse the effect of IK. IK preserves most of the consistency and diversity of the ray samples.
Q1: Advance over prior work
We appreciate the comment. We agree that previous works already use the well-established ray geometry. We use it to explicitly constrain a 3D-joint distribution, which a learned IK decodes into meshes with little loss.
Compared to the specific works:
Enforcing consistency is more difficult when a model is:
Our formulation addresses both:
Together, these give a better distribution than probabilistic baselines. We tighten our wording in the revised manuscript:
lines 113–115,132–136;line 92.