- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper compares forced answering to free continuations in LLM reasoning, in math and science settings. They show that a forced answer at the beginning of reasoning differs from the eventual answer later on, and is not always predictive of the final answer. They run experiments from partial chain-of-thought, showing that a larger test-time budget for continuations improves performance. The paper also includes a resampling experiment to measure the relation between the forced answer at various points of the rollout with the distribution of final answers from free continuations to see if one could have ended the reasoning trace there.
Critical strengths
None
Critical weaknesses
The paper's premise, that a forced answer due to an insertion in chain-of-thought does not correspond with readiness to stop, is self-evident. A forced answer occurs in the first place because of the insertion, not due to the model ending the reasoning trace. Measuring forced answer accuracy against free continuation accuracy (what reasoning LLMs are trained to do from RL) is not a comparison worth making in the first place. Prior work using forced answer accuracy measures whether a thinking budget is necessary for a particular problem, and the results of this paper add no new claims or nuance on top of this discussion.
The main finding in section 4.1 shows that an initially incorrect answer can be corrected with more chain-of-thought, which has been well-documented in the literature of test-time scaling. Additionally, in section 4.4 (Table 2), the authors match only additional generation tokens, not total computation, so the observed advantage of starting from a reasoning prefix is consistent with ordinary test-time scaling rather than demonstrating a novel benefit of the prefix. The prefix is anyways on-policy, so it is unclear exactly what claim the authors would be making in the first place, as it would be the same as continuing the original chain-of-thought.
Questions for authors
What is the purpose of comparing forced answer to readiness to stop? The intervention encourages the model to stop reasoning in the first place, as there is an insertion indicating a final answer.
Why use the a full continuation resampling as a method to claim that the forced answer was correct or incorrect in the case study? How does this function as a deployment case study if there are several parallel generations to verify a forced answer? How is this different than the forced answering experiments done in prior work (Lanham et al. 2023, Boppana et al. 2026)?
Why use the a full continuation resampling as a method in the deployment case study in §4.6? The proposed stopping policy requires eight parallel continuations at each checkpoint, making its increased inference cost unsurprising. How does this experiment meaningfully evaluate the efficiency of early stopping, rather than performing even more inference through free continuations? How does the paper's evaluation of forced-answer readouts meaningfully extend the experiments in Lanham et al. (2023) and Boppana et al. (2026)?