- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes CDPose, a diffusion-based framework for 3D whole-body pose modeling, covering body articulation, hand poses, and facial configurations. The method employs a unified 6D rotation representation to improve optimization stability and converts the predicted rotations into axis-angle representations for compatibility with parametric human models. Experiments across multiple benchmarks evaluate the proposed method on pose generation, denoising, completion, and human mesh recovery, demonstrating improvements over existing pose priors, including VPoser and DPoser-X.
Critical strengths
- The proposed framework combines part-specific diffusion priors with a fused residual module to model dependencies among different body regions. Furthermore, the mixed-training strategy allows the model to utilize heterogeneous datasets with incomplete body-part annotations. This design addresses a practical challenge in whole-body pose modeling, where fully annotated training data are often limited, and provides a flexible approach to integrating body, hand, and face information.
Critical weaknesses
- Several key components of CDPose, including the 6D rotation representation, diffusion-based pose priors, and Tweedie-based denoising, build upon existing techniques. Although the paper provides ablation studies demonstrating the benefits of individual design choices, it remains unclear to what extent the improvements arise from the proposed compositional architecture rather than the adoption of established representations and training strategies.
Questions for authors
-
Recent feed-forward human mesh recovery methods, such as SAM3D-Body, have demonstrated strong performance in 3D human reconstruction. While CDPose primarily focuses on learning a generative pose prior, it would be valuable to clarify its practical advantages over or potential complementarity with these approaches. Could the authors discuss whether CDPose can provide additional reconstruction accuracy or robustness when integrated with modern feed-forward models, and how such improvements compare with the additional computational overhead?
-
Could the authors clarify how facial shape and expression parameters are generated? Specifically, how should the facial generation experiments in Section 4.2 be understood in relation to Appendix D, which states that only joint rotations are diffused?
3 comments
Thanks for the detailed response. Despite there are some disagreement about this paper, I still appreciate authors' effort for handling this task. In this day and age, having the patience to study this topic is commendable. I decide to raise my rating to 4.
We sincerely thank the reviewer for their positive response to our rebuttal. We greatly appreciate their encouraging evaluation of our work.
Response to Comment 1 on where the gains come from
We agree, and one correction affects this comment directly. Part of the submitted ablation was invalid, because the rows we read as removing 6D are no-prior baselines, as explained in our response to Reviewer 2. So the submission did not show the benefit of 6D. The matched comparison in Table 6 now does, with a gain of 1.78 mm on ARCTIC hands under our objective.
The composition itself, with frozen part priors, residual fusion, and mixed training, comes from DPoser-X. We change the rotation state and the loss weighting, and Appendix B now separates these as far as the current numbers allow. In whole-body generation, adding the composition with our state and loss fixed lowers FID from 19.23 to 12.81 and raises precision from 0.57 to 0.81, as Table 13 below shows. A comparison with DPoser-X at fixed composition suggests that the state and loss mainly raise precision, but those DPoser-X numbers come from its own evaluator, so we treat that comparison as indicative only.
Excerpt of Table 13, whole-body generation. DPoser-X rows come from its own evaluator
In fitting, CDPose and DPoser-X share the composition, so the ARCTIC gain comes from the state and loss. On ARCTIC hands, removing the coordination term at fixed state and loss raises the error from 13.47 to 15.55 mm, as shown in Table 7. Switching to axis-angle raises it to 15.25 mm, and switching to DPoser's loss raises it to 15.33 mm, as shown in Table 6. The effects interact, since 6D helps more with our loss, so we report each with the others fixed rather than as shares of one total, as in the table below. All are single runs.
From Tables 6 and 7, one change from the full model, ARCTIC from scratch in mm
Response to Question 1 on feed-forward models such as SAM 3D Body
CDPose is an optimization prior, so using it to refine a stronger initializer is plausible, but we could not test SAM 3D Body within the rebuttal period, so an improvement over it is not established, and the limitations now say so. A strong feed-forward model is the better starting point, since SAM 3D Body reports 5.50 mm PA-MPJPE on FreiHAND against our 9.90 mm from keypoint fitting.
Our existing refinement results, collected in Appendix F.1, include a no-prior control. On ARCTIC from SMPLer-X, refitting without a prior leaves the all-vertex error at 26.33 mm against 26.15 mm for SMPLer-X, while CDPose reaches 23.24 mm. This setting uses ground-truth 2D keypoints and is therefore oracle-assisted. On EHF from CLIFF, the error drops from 56.62 to 48.16 mm, although every prior reaches 49 to 51 mm. So the gain comes from the prior rather than from refitting, and it is largest on the hands.
From Tables 5 and 9, refining a feed-forward output, errors in mm. ARCTIC uses ground-truth 2D keypoints
On cost, each optimization iteration adds one forward pass of the denoiser and no backward pass through it. We removed the earlier runtime table because it mixed our timings with DPoser-X's, so we do not quote a number.
Response to Question 2 on how facial shape and expression are generated
That appendix sentence was wrong and is removed. The face shape prior diffuses 100 FLAME shape coefficients, is trained on MICA registrations, and has no rotations. The face expression prior diffuses the jaw rotation in 6D and 100 expression coefficients and is trained on WCPA. For Sec. 4.2 we sample each prior from noise with the sampler shared by all priors, 1000 Euler-Maruyama steps, and score the samples with the same metrics as the baselines in Table 4. Table 17 now specifies what every prior diffuses, which rotations use 6D, and what is optimized at test time.