- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes DiBiHand, a diffusion-based framework for 3D hand mesh reconstruction. During the training stage, DiBiHand trains a diffusion model with multiple hand datasets to learn hand prior information. During the testing stage, DiBiHand leverages this diffusion prior as a regularizer and treats hand mesh reconstruction as a fitting process. Extensive experiments demonstrate its effectiveness over multiple hand benchmarks.
Critical strengths
- The proposed diffusion prior as a regularizer is effective in hand reconstruction. Particularly, I think it is useful in scenarios that occlusion exists to refine the hand poses.
- Extensive experiments on both multiple in-door and in the wild datasets are provided. The results are convincing.
Critical weaknesses
- The main proposed algorithm is similar to DPoser, with a fitting loss and a regularization loss. The only difference in algorithm seems to be switching SMLP to MANO model and using different 2D keypoint detection methods.
- The improvement in hand mesh recovery is not significant compared to other methods in Fig.5. Limited qualitative comparisons are provided with hand reconstruction methods. Fig. 18 presents further results with whole body reconstruction methods. While the first three cases are better, the fourth case seems worse than other methods when severe hand-object occlusion exists.
- Some typos affect the readability of the paper. There is no AI use statement, which is required in ICLR submission rules. “Section ??” in Appendix A. “Eq. equation” double equation representations. “..” in L270.
- Discussions are limited in Ablation studies. Authors present the experimental results, but further discussions regarding the results are encouraged.
Questions for authors
What are the highlights or advantages of DiBiHand compared with the previous method DPoser? Are there any specific challenges in the hand reconstruction scenario?