- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces a phonology-aware diffusion to better capture the correlations of hand motions in sign language production. Specifically, the authors highlight the issue of diffusion models to add independent noise to each body joint by introducing a PhonoNoise correlated noise in the hand region with covariance derived from the hand kinematic graph. The authors additionally introduce a PhonoContext component to model the temporal dimension of the hand wrist motions. The authors show significant performance improvements on several benchmarks.
Critical strengths
- The paper is well written and the motivation is clear and sound.
- The proposed approach achieves state-of-the-art results, outperforming recent baselines.
- The proposed approach is the first one to introduce structured noise in SLP
- The proposed approach is easy to be extended to any diffusion based SLP model.
Critical weaknesses
Novelty
One of the major concerns regarding this work is the novelty of the proposed PhonoNoise. Specifically, the graph derived covariance, that is the major contribution of this work, has been already introduced in SkeletonDiffusion (Curreli et al., 2025). PhonoContext, despite intuitive and well motivated, brings only minimal performance improvements and hence cannot be seen as a major contribution of this work.
Experiments
a) It is interesting why the authors focused their PhonoNoise only on the hand regions. A natural ablation would be to introduce a whole body (or upper body) kinematic graph which would capture also the relations between arm motions as well. Could the authors clarify this choice?
b) As it is common on SLP papers, a human user study would validate the quality of the generated motions and it is a notable limitation of the current work.
c) The paper does not include any video qualitative experiments. Given that the proposed work tackles a motion generation problem, a supplementary video would be required to quantify the performance improvements of the proposed framework and would validate the contributions of each component.
d) Could the authors clarify the contribution of each adjacency matrix in the covariance? Does the main benefit derive from the A_shape or the A_arr?
e) It is interesting that the BLUE scores are always better compared to the GT and it raises concerns about the quality of the evaluators.
f) It is interesting the baseline model in Tab 3 can achieve sota performance outperforming all previous works. Could the authors clarify if the baseline model contains any specific adjustments? If not it seems that the adjustments of the proposed work compared to the MDM baseline introduce only minimal improvements. Could the authors clarify?
Phonology Concept (Minor)
I think the phonology concept is slightly misleading as it is not directly related to any phonological attributes.
Questions for authors
I would appreciate if the authors could clarify my concerns regarding the a) novelty b) the whole body kinematic graph and c) the low BLUE score of the GT sequences.