- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Silent Tags, a framework for improving the paralinguistic expressiveness of speech-to-speech (S2S) models while preserving the reasoning capabilities of the underlying language model. The system freezes the language model's Thinker and trains only the Talker. Lightweight cross-attention layers allow the Talker to extract response-conditioned paralinguistic information from the Thinker's hidden states, enabling expressive speech generation without explicitly generating paralinguistic tag tokens at inference time. The authors evaluate the system's expressiveness across multiple benchmarks. The results show competitive expressiveness while preserving the frozen Thinker's text-side performance.
Critical strengths
The proposed method is simple yet effective. The authors also conduct an extensive set of experiments across multiple benchmarks and controlled settings. The experiments provide convincing evidence that the proposed method can enhance speech expressiveness while preserving the reasoning capabilities of the model.
Critical weaknesses
- The paper suffers from severe writing and presentation issues, including excessive and obscure terminology, inconsistent mathematical notation, and undefined or unused symbols. The figures are unclear. For example, models mentioned in the captions, such as Fish Audio and CosyVoice 2, are not clearly identifiable in the figures themselves, making it difficult to understand where or how they are used. And the experimental setup lacks sufficient details about baseline configurations. In addition, inconsistent evaluation protocols across tables undermine the comparability and reliability of the reported results. For example, the ablation study table in the appendix explicitly states, “These results are not directly comparable to Table 1,” which raises concerns about the consistency and comparability of the reported results.
- The core idea of leveraging intermediate hidden states from a frozen language model for speech generation, while preserving its existing reasoning capabilities is not novelty enough. May prior works explored this direction such like: @inproceedings{hong2026freezeempath, title={FreezeEmpath: Efficient Training for Empathetic Spoken Chatbots with Frozen LLMs}, author={Hong, Yun and Zhou, Yan and Feng, Yang}, booktitle={Findings of the Association for Computational Linguistics: ACL 2026}, pages={17141--17157}, year={2026} }
Questions for authors
Fig. 2 probes only three non-verbal events (Laughter, Sigh, Hesitation) on Qwen2.5-Omni, whereas the readout must support 48 categories, most of which are emotions and speaking styles. The text acknowledges that the probe "neither establishes coverage of all 48 tags nor isolates acoustic cues from correlated responsetext information." Could the authors provide further evidence that the information in layers 0–6 is sufficient to support expressive speech generation across the full tag set?