- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes MEGA-ASR for robust speech recognition through three contributions: a large-scale compound-degradation speech dataset, a three-stage acoustic-to-semantic fine-tuning strategy (A2S-SFT), and a WER-gated policy optimization method (DG-WGPO). Experiments on standard ASR and robustness benchmarks show improved performance over the Qwen3-ASR-1.7B backbone, reducing robust macro-average WER from 7.93% to 6.70%. Ablations and cross-backbone evaluations provide additional validation, though the individual contributions of the proposed mechanisms warrant further investigation.
Critical strengths
- Comprehensive evaluation and practical relevance. The paper evaluates MEGA-ASR across standard ASR datasets, established robustness benchmarks, and compound-degradation scenarios, providing evidence of improved robustness under challenging acoustic conditions.
- Systematic component analysis. The paper includes ablations of staged fine-tuning and reward components, as well as cross-backbone evaluations. These experiments help assess the contributions of different components and suggest that the approach may generalize beyond a single model configuration.
Critical weaknesses
- Limited methodological novelty. The proposed A2S-SFT and DG-WGPO primarily combine staged fine-tuning with heuristic reward components. The current experiments do not fully establish that these specific design choices are necessary or consistently superior to simpler alternatives under strictly matched training budgets.
- Insufficient evidence for the claimed mechanisms. Although the paper reports improvements and component ablations, the gains from WER-gated reward fusion over fixed fusion are relatively small. Stronger multi-seed comparisons, paired significance tests on performance differences, and analysis of candidate-ranking quality would be needed to substantiate the central methodological claims.
Questions for authors
- Clarification: Were the A2S-SFT and DG-WGPO comparisons matched for total training steps, compute budget, and data exposure? If so, could you clarify these controls? This would help determine whether the reported gains arise from the proposed mechanisms rather than additional optimization.
- Clarification: Were the improvements of WER-gated reward fusion over fixed fusion statistically significant across multiple random seeds? Given the relatively small differences in the ablation results, this would materially affect my assessment of DG-WGPO's contribution.
- Clarification: How well does the proposed approach generalize to real-world acoustic conditions that are independent of the synthetic degradation pipeline? In particular, what evidence supports the representativeness of the real-world evaluation subset and the absence of speaker or source leakage?