- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The main motivation of this paper is to use a latent reasoning chain that is composed of continuous vectors sampled from GMMs whose parameters are estimated by the LLM backbone. This enables reducing the number of time points that CoT utilizes. The experimental results show comparable performance with regular text CoT while showing advantages for latency.
Critical strengths
-
The paper proposes a feasible solution to convert the regular CoT approach to latent reasoning. It achieves this via chunking the the reasoning time steps, and learns continuous vectors instead of text decoded CoTs. This chunking results in reduction in latency which is useful for realtime conversation systems.
-
The experimental performance remains comparable with text-CoT based approaches largely.
Critical weaknesses
- The gains over Latent-MSE for instance remains low. And we do not have a comparison in terms of latency with other latent reasoning models.
Questions for authors
-
Did you compare the latency gains over the latent reasoning baselines such as Coconut, CODI, CoLaR, LatentMSE or LatentGMM?
-
Did you compare with larger base LALMs like QWEN 3.0 Omni? Having this would be helpful to see if the idea is helpful with larger models as well.
3 comments
Thank you for your detailed rebuttal. I will keep my positive score.
Thank you so much for your kind words and positive feedback! We truly appreciate your constructive review, which helps us improve our work. Thank you!
Response to Reviewer cZBo
Dear Reviewer cZBo,
Thank you for your review. All revisions are marked in blue in the updated PDF.
(1) Gains over Latent-MSE (Response to Weakness, first part)
Please refer to Line 382–383 on Page 8 of the revised manuscript.AURAL outperforms Latent_MSE at both stages and, after RL, also reaches the first answer token about 3× faster (see (2) below). The accuracy gap is modest after SFT but more than doubles after RL (Table 1):
SFT imitates one recorded CoT, so the benefit of modeling alternative continuations appears mainly once RL explores: Latent_MSE gains +0.95 from RL, while AURAL gains +2.36.
(2) Latency of the latent baselines (Response to Weakness, second part & Question 1)
Please refer to Line 417–418 on Page 8 and the new Appendix D.5 (Line 1376–1398, Page 26).As Sec. 3.1 notes, a latent trace of length L takes L sequential forward passes without chunking and ⌈L/m⌉ with it. We now measure this with the protocol of App. D:
(3) Larger backbone (Response to Question 2)
Please refer to Line 389–390 on Page 8 and the new Appendix H (Line 2195–2213, Page 41).We repeated the main comparison on Qwen3-Omni-30B-A3B-Instruct, a mixture-of-experts model with 30B total and 3B active parameters. Because of its training cost, CoT-RL and AURAL-RL are trained on a stratified 200K subset of AuralReason-683K with the same recipe.
AURAL-RL improves over Base on 9 of 11 metrics, including 3.71–5.96 points on EchoMind MCQ, IEMOCAP and MELD, and is slightly below the strong base on BBH and IFEval. It stays within 0.8 points of CoT-RL on 10 of 11 metrics. As on Qwen2.5-Omni, CoT-RL leads on BBH, here by 0.70. TTFT drops from 1.978 s to 0.160 s (12.4×), so both the accuracy pattern and the speedup carry over to the larger model.
Thank you again for your review. We hope these results answer your questions, and we would be grateful if you would take them into account in your final assessment.