- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Pruned CTC, a CTC-based method that restricts alignment computation to the subset formed by the union of target tokens and blanks of valid CTC alignments across a batch, while retaining full-vocabulary normalization. Furthermore, based on Pruned CTC, the paper also introduces LLM-CTC, which adapts pretrained LLMs for non-autoregressive ASR while retaining causal attention and native vocabularies, and extends it to bounded-history streaming. The results show that Pruned CTC can be utilized as a scalable sequence objective for native-vocabulary LLM ASR across offline and streaming settings.
Critical strengths
- The training memory reduction and inference-time speedup over LLM-CE are significant.
- The paper’s presentation is clear, and it has a strong theoretical foundation.
Critical weaknesses
- Baseline models’ RTF numbers are not provided in Table 4. The missing measurements make it difficult to assess its inference efficiency relative to existing ASR systems.
- Existing streaming LLM-based ASR systems are mentioned in the related work but are not included as baselines for LLM-CTC’s streaming comparison in Table 5.
Questions for authors
- See Critical Weaknesses. Can the authors further provide the data and comparisons mentioned to better assess the proposed method’s effectiveness?
- Table 1 shows additional training-time overhead for Pruned CTC compared with standard CTC. Can the authors further explain or provide a deeper analysis of this phenomenon?
- Can the authors extend the LLM-CTC evaluation to additional datasets to further demonstrate the models’ capability?