- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a target-speaker ASR framework that takes text cues, enrollment speech, or both through one shared conditioning interface. The contribution is architectural: a single model that supports different ways of identifying the target speaker, trained to distinguish valid cues from invalid ones.
Critical strengths
-
The paper addresses a real limitation of target-speaker recognition. Applications differ in what information is available to identify the desired speaker, and a common interface for lexical and acoustic guidance could make separate systems for each setting unnecessary. The individual mechanisms are established, but combining them this way is a useful contribution.
-
Processing enrollment speech without a separate speaker encoder also removes a model dependency. More broadly, the paper treats target specification as a flexible part of recognition, which gives a common framework for studying how different cues interact.
Critical weaknesses
-
SE-DiCoW already incorporates enrollment-sequence attention into ASR [1], LLM-TSE combines textual and enrollment guidance for speech extraction [2], and CALM integrates speaker conditioning with lexical biasing for recognition [3]. Their formulations differ from this submission, however, the authors should state what it adds in joint target specification and validity supervision, separately from the broader ideas of sequential enrollment conditioning and acoustic linguistic integration, which are already established.
-
Section 2.3 motivates negative-cue training as a way for the model to reject incorrect information and fall back on a valid alternative, yet the evaluation never systematically tests recognition when cues are incorrect or contradictory. Training on negative examples does not by itself show that the model behaves reliably in those conditions. Since resolving uncertain target information is a central reason for combining the modalities, this gap weakens the paper's main argument.
-
The paper acknowledges this tradeoff, but training always supplies both modalities, so it is unclear whether the degradation comes from the shared architecture or from the mismatch between training and inference. For applications where cue availability varies, that distinction decides whether one unified model can replace specialist systems.
References
[1] Alexander Polok, Dominik Klement, Samuele Cornell, Matthew Wiesner, Jan ernock˝, Sanjeev Khudanpur, and Luk·a Burget. "SE-DiCoW: Self-Enrolled Diarization-Conditioned Whisper." ICASSP, pp. 16712 16716, 2026. (https://arxiv.org/abs/2601.19194).
[2] Xiang Hao, Jibin Wu, Jianwei Yu, Chenglin Xu, and Kay Chen Tan. "Typing to Listen at the Cocktail Party: Text-Guided Target Speaker Extraction." IEEE Transactions on Cognitive and Developmental Systems, 18(2):361 372, 2026; preprint first published 2023. (https://arxiv.org/abs/2310.07284).
[3] Muhammad Shakeel, Yosuke Fukumoto, Chikara Maeda, Chyi-Jiunn Lin, and Shinji Watanabe. "CALM: Joint Contextual Acoustic-Linguistic Modeling for Personalization of Multi-Speaker ASR." ICASSP, 2026. DOI: 10.1109/ICASSP55912.2026.11463102. (https://arxiv.org/abs/2601.22792).
Questions for authors
Q1. How does recognition behave when one cue is incorrect, or when the cues point to different speakers?
Q2. Does training with missing modalities fix the single-cue degradation while keeping the benefit of joint conditioning?
Q3. Beyond differences in inputs and task formulation, what is the specific methodological advance over the closest prior architectures?