- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents ConGRets, a compact text-conditioned framework for 3D co-speech gesture generation without relying on speech audio. The method separates motion and speaker representation learning from text-conditioned gesture prediction. Specifically, it embeds two-second gesture units contrastively in a 10-dimensional latent space and uses a separate contrastive encoder to derive a global speaker descriptor from reference motion, enabling new-speaker conditioning without generator retraining. A fine-tuned text encoder and a fusion head predict the next motion latent from response text, speaker conditioning, and previous motion. The framework supports three synthesis modes: memory-based synthesis by selecting and blending recorded units, hybrid synthesis by decoding selected unit latents, and direct synthesis by decoding predicted latents.
Critical strengths
1.Detailed and transparent documentation of the experimental setup and results
Critical weaknesses
- Contrastive learning has been explored in prior co-speech gesture synthesis works, such as Semantic Motion Anchors(https://arxiv.org/abs/2605.30608 ) and SemConFlow(https://www.springerprofessional.de/en/semconflow-semantic-grounding-of-holistic-co-speech-gesture-gene/53692922), but the paper does not clearly distinguish its contributions.
- Lack of a user study to evaluate the perceptual quality and appropriateness of generated gestures.
- The paper does not provide ablation studies comparing text-only and text-audio conditioning within the same framework, leaving the impact of removing audio on gesture quality and speech-gesture synchronization unclear.
- Limited evidence of generalizability, as the model is trained only on BEAT and cross-dataset evaluations rely on target-speaker enrollment.
Questions for authors
- Could the authors clarify how the proposed method differs from these works(see above) and what its main contributions are?
- Could the authors provide a user study to evaluate the perceptual quality and appropriateness of the generated gestures?
- Could the authors provide ablation studies comparing text-only and text-audio conditioning within the same framework to clarify the impact of removing audio on gesture quality and speech-gesture synchronization?
- Given that the model is trained only on BEAT and cross-dataset evaluations rely on target-speaker enrollment, could the authors further demonstrate the generalizability of the proposed method by running experiments on other datasets, referencing SemTalk (https://openaccess.thecvf.com/content/ICCV2025/papers/Zhang_SemTalk_Holistic_Co-speech_Motion_Generation_with_Frame-level_Semantic_Emphasis_ICCV_2025_paper.pdf)?