- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces AHand20, an anatomy-informed 20D hand pose representation. While MANO parameterizes each joint with a general 3-axis rotation, AHand20 describes the hand with per-joint anatomical angles, such as flexion and spread, that follow the degrees of freedom of each joint. AHand20 can be converted to and from MANO, which enables controllable pose augmentation in the anatomical space and allows existing MANO-based pipelines to be reused for rendering. Using this augmentation, the paper constructs a pose-text dataset of 154 handshapes and trains a text-conditioned generator that decodes through AHand20. The proposed method, built upon PoseScript, outperforms the adapted baselines, which suggests that an anatomy-informed intermediate representation is useful. The representation is also used to identify implausible poses in existing datasets, suggesting the utility of the proposed anatomy-informed representation.
Critical strengths
[S1] A well-motivated, interpretable, and practical framework. The proposed 20D anatomical representation is well-motivated and practical, addressing MANO’s limitations in generating anatomically plausible hand poses while facilitating more effective data augmentation to improve generalization. In particular, AHand20 enhances interpretability by explicitly modeling joint constraints and articulations based on hand anatomy, enabling more intuitive and controlled pose modifications. Overall, the work is clearly motivated, and its straightforward yet effective design offers practical value for hand pose representation and generation.
Critical weaknesses
[W1] Limited novelty beyond prior reduced-DoF representations and PoseScript. Representing a hand or body pose with a reduced set of anatomically meaningful DoFs is a well-established and straightforward idea [1-3]. The conversion between the 20D space and MANO enables practical data augmentation, but no design specifically tailored to this task beyond prior work is significant. In particular, the only difference from PoseScript is an intermediate 20D representation space inserted before the 45D hand pose is generated. Therefore, although the proposed intermediate representation is shown to be useful and practical compared with the benchmarked methods, the work offers limited substantive methodological or architectural advancement.
[W2] Baselines are adapted from body-pose methods, and their adaptations are not fair or not clearly described.
- All baselines in Table 1 were originally designed for body pose rather than hand pose. Also, other diffusion-based text-conditioned pose/hand-pose generation methods should be included, such as a static variant of HandMDM [4] and the text-to-hand-parameter stage of HanDiffuser [5]. This diffusion-based family is missing from the current comparison.
- PoseFix is a pose-editing method. How it is converted to a generation task, including the choice of the fixed source pose, should be described.
- UniPose's LLM backbone is replaced with DistilBERT, which is far weaker than the original (LlaVA-1.6V). In contrast, ChatPose keeps LLaVA-v1.5-13B. The reason for this inconsistency should be justified, and the fine-tuning strategy for ChatPose (full fine-tuning or LoRA) should be specified.
- AHand20 is applied only to the PoseScript-style model. Applying the same 20D output space to the other baselines would show whether the gain generalizes across architectures.
References
[1] K. Yao and A. Billard, “An inverse optimization approach to understand human acquisition of kinematic coordination in bimanual fine manipulation tasks,” Biological Cybernetics, vol. 114, pp. 63–82, 2020. https://doi.org/10.1007/s00422-019-00814-9.
[2] X. Zhou, Q. Wan, W. Zhang, X. Xue, and Y. Wei, “Model-Based Deep Hand Pose Estimation,” in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), 2016, pp. 2421–2427. https://arxiv.org/abs/1606.06854.
[3] Y. Xia, X. Zhou, E. Vouga, Q. Huang, and G. Pavlakos, “Reconstructing Humans with a Biomechanically Accurate Skeleton,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025, pp. 5355–5365. https://arxiv.org/abs/2503.21751.
[4] L. Bensabath, M. Petrovich, and G. Varol, “Text-Driven 3D Hand Motion Generation from Sign Language Data,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026. https://arxiv.org/abs/2508.15902.
[5] S. Narasimhaswamy, U. Bhattacharya, X. Chen, I. Dasgupta, S. Mitra, and M. Hoai, “HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024, pp. 2468–2479. https://arxiv.org/abs/2403.01693.
Questions for authors
[Q1] How are the 20D targets annotated? Sec. 4.1 and Appendix B.1 only state that the targets are "manually specified" under the guidance of 2D source images. Since all reference poses, augmented variants, and test ground truths derive from these targets, please clarify:
- How the 20 continuous angles are determined for each handshape (e.g., discrete levels, per-state templates, or iterative fit-and-render tuning).
- The number of annotators, their expertise, and whether inter-annotator consistency was assessed.
[Q2] What are the limitations and future directions? Please include and discuss limitations of the proposed work. For example, extending the concept of AHand20 to the full human body would likewise require additional joint-specific anatomical definitions. This may limit the scope and applicability of the method in more general settings.
5 comments
Response to Reviewer 9jF3 (Part 2 / 3)
Q3: PoseFix is a pose-editing method. How it is converted to a generation task, including the choice of the fixed source pose, should be described.
A3: Appendix D.1 (line 1393) of the original paper describes the PoseFix adaptation: we fix the source pose and replace editing instructions with handshape descriptions. Specifically, the source uses all-zero MANO pose parameters during both training and inference.
Q4: UniPose's LLM backbone is replaced with DistilBERT, which is far weaker than the original (LlaVA-1.6V). In contrast, ChatPose keeps LLaVA-v1.5-13B. The reason for this inconsistency should be justified, and the fine-tuning strategy for ChatPose (full fine-tuning or LoRA) should be specified.
A4: We thank the reviewer for raising this concern. It is important to clarify the role of the text encoder for a fair and transparent comparison. We additionally evaluated UniPose with its native LLaVA-1.6-Mistral-7B backbone and ChatPose with frozen DistilBERT. We also combined both LLaVA encoders with our VAE, AHand20 decoder, and learned MANO projector.
R4-Table2: Text encoder comparison for UniPose, ChatPose, and Ours. Position errors are in millimeters, rotation error is in degrees, and R@K is in percent.
| Method | Text encoder | MPJPE ↓ | MPVPE ↓ | Rotation ↓ | R@1 ↑ | R@5 ↑ | FID ↓ |
|---|---|---|---|---|---|---|---|
| UniPose | DistilBERT | ||||||
| UniPose | LLaVA-1.6-Mistral-7B | ||||||
| ChatPose | DistilBERT | ||||||
| ChatPose | LLaVA-1.5-13B | ||||||
| Ours | DistilBERT | ||||||
| Ours | LLaVA-1.6-Mistral-7B | ||||||
| Ours | LLaVA-1.5-13B |
Both UniPose and ChatPose perform better with their LLaVA backbones than with frozen DistilBERT. Our framework also benefits from these stronger text encoders, improving all three geometric metrics over the original DistilBERT-based model. These results suggest that both large text encoders and AHand20 benefit text-conditioned pose generation. Larger text encoders require more computational resources for training, while AHand20 adds little computational overhead.
ChatPose uses LoRA rather than full fine-tuning: rank 128, alpha 256, and dropout 0.05, together with a trainable 15-joint output head. LoRA targets the attention projections and MLP projections. We train for five epochs at learning rate and select the checkpoint using validation data.
Response to Reviewer 9jF3 (Part 3 / 3)
Q5: AHand20 is applied only to the PoseScript-style model. Applying the same 20D output space to the other baselines would show whether the gain generalizes across architectures.
A5: We thank the reviewer for suggesting this experiment to test whether AHand20's benefits extend beyond the PoseScript-style generator. We selected DPoser [1], MAA [2], PoseD-Flow [3], and T2P [4] to cover diffusion, flow matching, and autoregressive generation. We integrated AHand20 outputs, our learned MANO projector, and geometric losses into each method.
R4-Table3: Geometric errors before and after adding AHand20 with learned MANO projection and geometric supervision.
| Architecture | Original MPJPE ↓ (mm) | + AHand20 MPJPE ↓ (mm) | Original rotation ↓ (°) | + AHand20 rotation ↓ (°) |
|---|---|---|---|---|
| DPoser | ||||
| PoseD-Flow | ||||
| T2P | ||||
| MAA |
These methods benefit from our AHand20-based framework, suggesting that the gains generalize across architectures. The experiments are now included in Sec. 5.3 of the revised manuscript.
References
[1] Lu et al. DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior. ICCV, 2025.
[2] Azadi et al. Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation. ICCV, 2023.
[3] Nadar, Foti, and Birdal. PoseD-Flow: Versatile and Guided Flow Matching Model of Human Pose. CVPR, 2026.
[4] Bonnet et al. From Text to Pose to Image: Improving Diffusion Model Control and Quality. arXiv:2411.12872, 2024.
Q6: How are the 20D targets annotated? Sec. 4.1 and Appendix B.1 only state that the targets are "manually specified" under the guidance of 2D source images. Since all reference poses, augmented variants, and test ground truths derive from these targets, please clarify: how the 20 continuous angles are determined for each handshape (e.g., discrete levels, per-state templates, or iterative fit-and-render tuning); the number of annotators, their expertise, and whether inter-annotator consistency was assessed.
A6: The annotation was carried out collaboratively by the authors, who have research experience in 3D hand modeling and pose analysis. We used iterative fit-and-render tuning to determine the 20D targets. For each reference image, we adjusted the anatomical angles, fitted the corresponding MANO pose, and compared the rendered handshape with the reference. This process is now described in Appendix B.1 of the revised manuscript (p. 20).
Q7: What are the limitations and future directions? Please include and discuss limitations of the proposed work. For example, extending the concept of AHand20 to the full human body would likewise require additional joint-specific anatomical definitions. This may limit the scope and applicability of the method in more general settings.
A7: AHand20 currently focuses on hand articulation. Extending this approach to full-body models such as SMPL-X [5] could enable interpretable control of whole-body poses. This would require additional joint-specific anatomical definitions. Another direction is to incorporate AHand20 as an anatomical prior into hand pose estimation to reduce anatomically implausible predictions and improve 3D reconstruction accuracy. We have added this discussion in Sec. 6, "Limitations and Discussion," of the revised manuscript (p. 10).
References
[5] Pavlakos et al. Expressive Body Capture: 3D Hands, Face, and Body from a Single Image. CVPR, 2019.
We are grateful for the opportunity to clarify our contribution and strengthen the experimental comparisons. If these additions address your concerns, we hope you will consider updating your rating. Thank you for your time and feedback.
Response to Reviewer 9jF3 (Part 1 / 3)
Thank you for examining our work in detail and for outlining how the contribution and experimental comparisons could be made clearer. Your assessment describes AHand20 as a well-motivated, interpretable, and practical framework, with particular strengths in intuitive pose control and anatomically informed augmentation.
Your comments highlight the need to clarify our contribution, strengthen the baseline comparisons, and explain the reference-pose annotation process. We have added experiments and revised the relevant descriptions, together with a discussion of limitations and future directions.
Q1: Limited novelty beyond prior reduced-DoF representations and PoseScript. Representing a hand or body pose with a reduced set of anatomically meaningful DoFs is a well-established and straightforward idea [1–3]. The conversion between the 20D space and MANO enables practical data augmentation, but no design specifically tailored to this task beyond prior work is significant. In particular, the only difference from PoseScript is an intermediate 20D representation space inserted before the 45D hand pose is generated. Therefore, although the proposed intermediate representation is shown to be useful and practical compared with the benchmarked methods, the work offers limited substantive methodological or architectural advancement.
A1: In the original paper, developing a new generator architecture is neither the purpose nor a claimed contribution. We use a PoseScript-based generator only to evaluate AHand20.
The cited works differ from ours in their skeletal models and research objectives. Zhou et al. [2] and HSMR [3] use libhand and SKEL, respectively, while AHand20 is defined for MANO. Yao and Billard [1] use a kinematic hand model to study coordination in bimanual manipulation, without developing a representation for pose control.
References
[1] Yao and Billard. An Inverse Optimization Approach to Understand Human Acquisition of Kinematic Coordination in Bimanual Fine Manipulation Tasks. Biological Cybernetics, 2020.
[2] Zhou et al. Model-Based Deep Hand Pose Estimation. IJCAI, 2016.
[3] Xia et al. Reconstructing Humans with a Biomechanically Accurate Skeleton. CVPR, 2025.
Q2: All baselines in Table 1 were originally designed for body pose rather than hand pose. Also, other diffusion-based text-conditioned pose/hand-pose generation methods should be included, such as a static variant of HandMDM [4] and the text-to-hand-parameter stage of HanDiffuser [5]. This diffusion-based family is missing from the current comparison.
A2: We thank the reviewer for recommending these hand-focused diffusion methods. Including them broadens the comparison and strengthens the experimental evaluation. We additionally evaluated a static adaptation of HandMDM [4] and the text-to-hand-parameter stage of HanDiffuser [5]. The results are shown below.
Our method achieves lower geometric errors and FID than HandMDM and HanDiffuser, with the highest R@1 and comparable R@5 to HandMDM.
References
[4] Bensabath, Petrovich, and Varol. Text-Driven 3D Hand Motion Generation from Sign Language Data. CVPR, 2026.
[5] Narasimhaswamy et al. HanDiffuser: Text-to-Image Generation With Realistic Hand Appearances. CVPR, 2024.