- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper introduces a new method to make the reasoning model more efficient by getting the same accuracy with fewer tokens. The main idea here is that after a model reaches an answer and becomes stable in its reasoning process, the model should close the thinking part of its reasoning and start outputting the final answer. So, this motivates the authors to fine-tune the model to increase its probability of outputting </think> and closing its thought process in stable boundaries. However, this leads the model to repeatedly outputting </think> without producing an answer, and this motivates the authors to add a regularizer term to follow the distribution of the base model in non-boundary tokens. Across several reasoning models and benchmarks, Settle cuts reasoning tokens by roughly 13–49% with small accuracy changes, outperforming baselines.
Critical strengths
- The paper clearly explains its observation about the stability and properly motivates its training objective. It also has done a rigorous study on the effect of the KL and stopping weights.
Critical weaknesses
-
There are some problems with the experiments. The first one is some missing baselines that have already outperformed DEER [1, 2]. Also, I am not sure how much improvements the method gains over DEER. For example, I am not sure that Settle is Pareto dominant over DEER from Figure 2. The other problem is also the evaluation benchmarks. More benchmarks lie towards the easy spectrum of benchmarks, and papers miss harder benchmarks like AIME or even harder.
-
The model has several hyperparameters that might be challenging for tuning. The authors provided a complete sensitivity of these hyperparameters that in most cases seems to be less sensitive. However, there are cases as in Table 24 that performance is sensitive w.r.t. .
[1] Hosseini, Parsa, et al. "Early Stopping for Large Reasoning Models via Confidence Dynamics." arXiv preprint arXiv:2604.04930 (2026).
[2] Wang, Xi, et al. "Conformal thinking: Risk control for reasoning on a compute budget." arXiv preprint arXiv:2602.03814 (2026).
Questions for authors
-
Please refer to weaknesses.
-
I do have some concerns about what the training objective is actually teaching; it pushes the model to stop earlier and shorten its reasoning overall, while trying to be close to the base model. In particular, I am not sure how much of the improvement comes from the label signal itself. Can the authors run some controlled experiments with, for example, random labels, and be tuned to match Settle’s token count?
Dear Reviewer,
As the author–reviewer discussion deadline approaches, I would like to remind you to review the authors’ rebuttal and indicate whether your concerns have been adequately addressed.
If you have any remaining concerns or questions, please share them with the authors before the discussion period ends.
Thank you again for your time and valuable feedback.