- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to develop an early stopping for reasoning models. Previously, early stopping methods mostly used confidence or entropy as the signal for early stopping since these signals indicate that model has reached the final solution and is just wasting tokens. However, these methods don't account for the case where the model is confident but still exploring. To this end, the authors propose PUMA, a method that stops when reasoning has converged and the model is confident. To verify whether the reasoning has converged, PUMA uses a fine-tuned embedding model (with contrastive loss) to measure the similarity of each steps with its previous steps. PUMA obtains better token reduction across different models while achieving the same accuracy in comparison with baselines.
Critical strengths
- I think the experimental results are the main strength of the paper. The authors have compared their method with baselines across many domains including vision language reasoning. In many cases their method beats existing method because PUMA can use a more conservative threshold than the existing confidence-based methods.
Critical weaknesses
-
I have concerns regarding the novelty of the method for this venue. The main intuition of the method has already been discussed in the RCPD paper [1]. Although RCPD method doesn't use an embedding model, but the authors of that paper have already showed the convergence of the reasoning using an embedding model.
-
Some baselines are missing. For example [2] and [3] are early stopping methods considering two cases: i) stopping when the model is too confident and wasting budget ii) stopping when the model shows incompetency in its problem solving. I think the authors need to compare their method with these methods as well.
[1] Wei, Zihao, et al. "The evolution of thought: Tracking llm overthinking via reasoning dynamics analysis." Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2026.
[2] Hosseini, Parsa, et al. "Early Stopping for Large Reasoning Models via Confidence Dynamics." arXiv preprint arXiv:2604.04930 (2026).
[3] Wang, Xi, et al. "Conformal thinking: Risk control for reasoning on a compute budget." arXiv preprint arXiv:2602.03814 (2026).
Questions for authors
-
Please look at the critical weaknesses.
-
I have some concerns regarding hyperparams. In particular, choice of tau seems to have a significant effect on the final acc and token reduction. Can authors elaborate on this?
-
it seems the authors are using a different notion of step in comparison to DEER (which uses "wait" to separate steps). Could the authors apply DEER stopping rule to their steps and report the results. I do wonder how much step definition impacts the results.