- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a training-free acoustic data-pruning method for ASR using cumulative spectral entropy, spectral flux, and log-Mel temporal variation to rank training utterances. Experiments with Conformer on LibriSpeech show that Log-Mel Temporal Variation achieves the best performance among evaluated methods at 5% and 1% retention, while reducing selection time from 13.73 hours for Teacher–Student scoring to approximately 0.42 hours. Ablations support cumulative over mean aggregation under an utterance-count budget. However, evaluation is limited to one dataset and model architecture, and the contribution of acoustic variation beyond utterance duration remains insufficiently isolated.
Critical strengths
- Excellent selection efficiency. The proposed criteria require neither pruning-specific model training nor learned-model inference. Log-Mel Temporal Variation scores the LibriSpeech training set in approximately 0.42 hours using CPUs, compared with 13.73 hours for Teacher–Student selection. This makes the approach attractive when computational resources are limited.
- Strong results under restrictive data budgets. At 5% retention, Log-Mel Temporal Variation achieves 10.5% WER on test-clean and 21.0% on test-other, outperforming the evaluated Teacher criterion (13.6% and 24.3%, respectively). The paper also compares cumulative and mean aggregation and includes simple word-count and phone-count baselines, providing useful evidence for its design choices.
Critical weaknesses
- Limited evaluation scope and statistical evidence. All experiments use LibriSpeech and a single Conformer training setup. The paper does not establish whether the gains persist across different ASR architectures, speech domains, or independent training runs. This makes it difficult to determine whether the method provides a broadly applicable pruning strategy or primarily benefits this particular setup.
- Insufficient isolation of the cumulative acoustic signal. Cumulative scores naturally depend on utterance duration as well as local acoustic variation. Although the paper compares against word-count and phone-count baselines, it does not directly establish how much of the improvement comes from acoustic dynamics rather than duration alone. This leaves the central explanation for the method's effectiveness partially unresolved.
Questions for authors
- Robustness: Can the authors report results across multiple independent ASR training seeds, including variance or confidence intervals, to establish whether the improvements over Teacher and Random selection are statistically robust?
- Duration confounding: Can the authors compare the proposed cumulative acoustic scores against a duration-only ranking baseline, or otherwise control for utterance duration, to isolate the contribution of acoustic variation?
- Generalization: Do the proposed criteria retain their advantages on another ASR architecture or speech dataset, particularly at the 5% retention budget where the paper reports its strongest gains?