- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes X-AuT, a framework for compressing the audio encoder of Qwen3-ASR through progressive layer pruning and cross-scale distillation. It combines behavioral layer selection, representation alignment, scheduled student-policy supervision, and fine-tuning. Evaluation covers ten Chinese and English benchmarks. The reported models remove up to 20.7% of audio-tower parameters while approximately preserving macro-average recognition error.
Critical strengths
The paper targets a practical problem and evaluates recognition accuracy across ten public benchmarks. The matched teacher-scale and progressive vs. direct pruning comparisons provide useful evidence supporting parts of the framework.
Critical weaknesses
- W1: The empirical justification for the complete framework remains incomplete. There are no controlled ablations establishing the necessity of representation alignment or transcript-consistency filtering, even though the conclusion states that alignment is necessary. Moreover, Appendix A.6 reports that hybrid on-policy training performs worse than the matched off-policy control, with best TER of 6.41% versus 6.23%. An unpruned model adapted using the same data and teacher is also missing, making it difficult to separate the reported accuracy improvement from additional training and stronger supervision.
- W2: The practical advantage over alternative compression approaches is insufficiently established. Appendix A.7 reports inference measurements, but the end-to-end latency reductions are only 2.6% on H800 and 4.7% on the in-vehicle accelerator. There is no comparison against competing compression methods or simpler pruning-and-recovery baselines at matched accuracy and training budgets. The cost of candidate screening and the complete recovery pipeline is also unreported, leaving the overall accuracy vs. efficiency tradeoff unclear.
Questions for authors
- Q1: Can the authors provide controlled comparisons removing representation alignment and transcript filtering, alongside an unpruned model trained with the same data and teacher? These controls would clarify which components account for the results.
- Q2: Given that matched off-policy training outperforms hybrid on-policy training in Appendix A.6, what evidence supports retaining student-policy supervision in the proposed framework?
- Q3: Can the authors compare against a simpler compression baseline under matched recovery budgets and report both end-to-end inference efficiency and total compression cost?