- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 3(+1)
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GHM, a unified model for hand motion reconstruction, infilling, and text-conditioned generation.
The model is trained on large-scale hand motion and egocentric datasets. Experimental results demonstrate significant improvements in hand motion reconstruction, generation, and infilling tasks.
Critical strengths
- The authors have a clear primary objective: to achieve hand motion reconstruction, infilling, and generation within a unified framework. The overall design is centered around this objective.
- The paper presents extensive experimental comparisons with existing models across multiple tasks and datasets. The overall experimental evaluation is comprehensive. The supplementary material further demonstrates the effectiveness of GHM through qualitative results.
- The experimental results demonstrate the strong performance of GHM. The unified framework outperforms existing models on reconstruction, infilling, and generation tasks, validating the effectiveness of the proposed approach.
Critical weaknesses
- Limited novelty. The main contribution of this paper is to integrate Hand Motion Reconstruction, Infilling, and Generation into a unified framework. However, most of the model's core technical components are based on existing methods, with limited novel methodological contributions.
- Insufficient ablation studies. This paper uses large-scale training data to jointly train three tasks within a unified framework. However, the authors do not provide sufficient ablation studies to demonstrate to what extent the performance improvements come from large-scale training and to what extent they benefit from joint supervision across the three tasks.
- Limited analysis of model complexity and efficiency. This paper proposes a generative model based on a DiT architecture and diffusion, which generally implies a larger model and higher inference overhead. The authors report the number of Transformer layers, but could they provide more detailed information about the model's parameter count and inference speed? If possible, I would also appreciate comparisons with other existing methods. This would help potential users assess the additional computational cost associated with the performance improvements.
Questions for authors
Could the authors provide further analysis to clarify to what extent the performance improvements of GHM come from large-scale training data, and to what extent they benefit from joint training across Reconstruction, Infilling, and Generation?
Rebuttal summary
Dear SACs, ACs, and Reviewers,
We sincerely thank all reviewers for their insightful feedback and constructive suggestions.
We appreciate their recognition of the clear motivation and unified formulation of hand-motion reconstruction, infilling, and generation (Reviewers vDNd and cd3P), as well as the comprehensive experimental evaluation and strong performance across multiple tasks and datasets (Reviewers cxCo and cd3P). We also appreciate the recognition of the carefully matched evaluation protocols and the practical value of learning from heterogeneous egocentric datasets (Reviewer cxCo), and the effectiveness of the cross-representation consistency objective (Reviewer vDNd).
In response to the reviewers' constructive feedback, we have further clarified the methodology and strengthened the experimental analysis. The improvements are summarized below:
We have incorporated these clarifications and additional analyses into the revised manuscript, with expanded discussions of experimental findings and improved presentation.
Once again, we sincerely thank the SACs, ACs, and reviewers for their time and valuable feedback.
Best regards,
The Authors