- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a 3-stage training to improve the performance of a contextual ASR system. This includes 1) regular ASR fine-tuning, 2) Context-robust ASR fine-tuning, where the context (e.g. entities) are replaced with unrelated contexts for a subset and 3) RL stage (GRPO) which includes a lexical component (contextual ASR) and a semantic component - pronoun dismbiguation. Results show that adding the pronoun disambiguation task improves the performance of contextual ASR over the baseline (Qwen3-asr). On pronoun disambiguation, the model improves some of the metrics (She-R, It-R, overall-recall) but not others (He-R). Further ablations show that including the semantic task in RL improves performance with misleading contexts.
Critical strengths
- Proposes a strategy to use an additional pronoun disambiguation task to improve performance of contextual ASR, specifically in misleading contexts.
- Results show that the strategy improves upon a baseline (Qwen3-asr) in terms of both Contextual ASR (Character Error Rate) and Pronoun-disambiguation
Critical weaknesses
- The paper does not have a second SFT stage consisting only of the semantic task i.e. pronoun disambiguation i.e. Base SFT, Context SFT, Semantic SFT. Such a baseline would give the readers an insight into whether the RL stage is necessary for the semantic task or whether it can be included via an SFT stage.
- Some parts of the paper are hard to follow. See Questions below.
Questions for authors
- L019: This sentence is unclear and does not connect well with the previous sentence . "The lexical objective uses … while the semantic objective rewards".
- Sec 3.4.2: What is \hat{y}?
- Equation 3: what is s \precurlyeq {\hat{y}?
- Table 3: Why is Ours (GRPO-RL) worse on He-R compared to the baseline but better on She-R and It-R?
- Table 4: What is Direct GRPO?
2 comments
Thanks for the clarifications. I will be updating my scores.
Thank you for carefully reviewing our paper and providing constructive suggestions. Your comments have helped us further improve our experimental analysis and the presentation of the paper. In response to your questions, we have added relevant experiments and detailed explanations in the appendix, along with additional experiments, including results under different reward weight settings and different random seeds. We address your comments one by one below.
Using the same amount of training data and the same training settings, we added a General ASR SFT → Context-SFT → Semantic SFT baseline. These results show that SFT improves pronoun-disambiguation performance. However, GRPO achieves further gains on this benchmark, increasing macro-F1 from 88.29% to 89.70% (+1.41 percentage points) and improving recall across all three pronoun classes. The specific metrics are reported below. Among these, "Ours (Stage III SFT)" refers to Semantic SFT. You can also find detailed results in the Ours (Stage III SFT) row of Table 7 in the appendix.
Contextual ASR results (%) on the semantic evaluation sets.
Pronoun Disambiguation: He-R, She-R, It-R, and Macro-F1.
He-R, She-R, and It-R denote class-wise pronoun recall. Best results for each metric are shown in bold.
Q1.
This sentence elaborates on the task-specific GRPO stage introduced in the preceding sentence. Specifically, “lexical objective” and “semantic objective” refer to the two task-specific reward functions used in Stage III for lexical verification and pronoun disambiguation, respectively. To make this connection clearer, we will revise the sentence as follows:
Q2.
y^ denotes the full transcription predicted by the model from the input speech and textual context, while y denotes the reference transcription. We will explicitly define this notation at its first occurrence in the revised manuscript.
Q3.
In Equation 3, s⪯yˉ means that s is a contiguous substring of the normalized model-generated transcription yˉ. The minimization finds the substring with the smallest edit distance to the normalized target entity. We will explicitly define this notation in the revised manuscript.
Q4.
The baseline achieves 96.04% recall for He, but only 28.83% for She and 48.48% for It. This substantial asymmetry is consistent with a tendency to over-predict He, which can yield high He recall while misclassifying the other pronoun forms. Our model exhibits more balanced class-wise recall: although He recall decreases to 92.09%, She and It recall increase substantially to 81.08% and 94.44%, respectively. Consequently, macro-F1 improves from 61.14% to 89.70%. These results indicate a trade-off between He recall and overall performance across the three pronoun classes.
Q5.
Direct GRPO is initialized from the checkpoint obtained after Stage I, General ASR SFT, and proceeds directly to Stage III, GRPO, skipping Stage II, Context-SFT. Its training path is therefore:
Qwen3-ASR -> General ASR SFT -> GRPO.
In contrast, the full model follows:
Qwen3-ASR -> General ASR SFT -> Context-SFT -> GRPO.
This ablation is intended to assess the contribution of the intermediate Context-SFT stage before GRPO. We will clarify the initialization and training path of Direct GRPO in the table caption and accompanying text.
Thank you again for the time and effort you devoted to reviewing our paper and for your valuable suggestions.