- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether improvements from NoThink post-training partly arise from reactivating thinking behavior already available in the base model. It constructs a Think–NoThink activation direction and uses bidirectional interventions to measure its contribution to performance gains across several models and training methods.
Critical strengths
-
Relevant question. The paper examines an important ambiguity in evaluating hybrid reasoning models: improved NoThink performance may reflect greater use of existing thinking behavior. Distinguishing these explanations can help interpret post-training gains.
-
Bidirectional evidence. The combination of representational analysis, steering in the base model, and counter-steering in trained checkpoints provides stronger evidence than behavioral observations alone. Evaluating multiple models and training methods also broadens the empirical support.
Critical weaknesses
- Unclear specificity. The Think–NoThink direction is constructed from averages over generated tokens and may capture differences in length, token position, and response style alongside deliberation. The clean-answer reference and random-direction controls do not fully separate these factors. Consequently, performance changes under intervention do not uniquely establish how much improvement is caused by thinking leakage.
- Limited methodological novelty. CoT Vectors [1] already extracts reasoning vectors by contrasting activations with and without CoT. The paper should clarify what its Think–NoThink direction and subsequent interventions reveal beyond this existing approach.
- Practical implications need clarification. Reactivating existing thinking ability can still be a useful outcome of NoThink post-training, particularly if it improves accuracy while reducing inference cost. Although Appendix B.1 acknowledges this possibility, the paper could explain more concretely how its leakage estimates should inform the evaluation of such gains.
[1] CoT Vectors: Transferring and Probing the Reasoning Mechanisms of LLMs
Questions for authors
Do the main findings hold when the direction is estimated from length-matched, position-matched responses, or from the thinking region alone?
What additional insight does the proposed audit provide over existing CoT-versus-direct-answer steering methods? Would those directions produce similar estimates of the contribution to performance gains?
Given that reusing existing thinking ability can still improve reasoning efficiency, how should the leakage estimate affect our assessment of a post-training method’s value?
5 comments
Response to Reviewer FYFB: Part 2
Response to Weakness 2 and Question 2: We thank the reviewer for the pointer; we have added CoT Vectors to Sec. 7 Related Work.
CoT Vectors measures a different contrast. Its vector is the difference in answer-segment activations with and without a CoT prefix, applied to strengthen reasoning at low cost. This corresponds to our reference vector (Appendices D.1, E.1, F.2), which contrasts NOTHINK with the answer THINK writes after deliberation. instead contrasts the full THINK rollout, deliberation included, with NOTHINK, i.e., the two modes themselves. The two behave differently in our experiments: post-training barely moves NOTHINK along the reference direction, and steering along it does not raise accuracy. It is also worth noting that CoT Vectors reports gains of +4.6 and +1.9 points on two non-hybrid models even with learnable vectors, whereas a plain difference-of-means vector raises NOTHINK accuracy by up to 27 points on our hybrid models (Sec. 4). This is consistent with our central point: in hybrid models, existing reasoning is unusually easy to re-invoke in NOTHINK, which is what makes leakage a concern.
Our contribution is an audit, not a steering method. Steering is a widely used technique, from controlling model preferences to adjusting reasoning speed or backtracking (Lin et al., 2025; Venhoff et al., 2025; Sinii et al., 2025; the first paragraph of Sec. 7). In this line of work, including CoT Vectors, the direction is the product: a vector injected to enhance or control behavior. We use it as an instrument for a different question: for a checkpoint that reports a NOTHINK gain, how much of that gain depends on the checkpoint having moved along this direction. As the reviewer noted among the strengths, our contribution is this question and the causal framework that answers it with bidirectional interventions. To our knowledge, this is the first representation-level audit of leakage in hybrid models.
- What is audited. Steering alone, including Sinii et al.'s result that a vector can match RL, shows that a gain is reachable without weight updates. It does not show how much of a specific checkpoint's gain actually runs through that direction. We measure how far post-training moved each checkpoint along it (Sec. 3), remove that movement (Sec. 5), and decompose the reported gain (Sec. 6), checking the reading against steering the base model (Sec. 4).
- Where the direction comes from. Prior directions rely on engineered extraction: CoT-prompted inputs, length-matched stimuli, annotated token spans, or optimized vectors. Hybrid models supply both modes from the same weights under a template switch, so a plain difference of means suffices, and it is stable at mid-depth, where CoT Vectors reports extracted vectors to be unstable.
Would CoT-versus-direct directions give similar estimates? Our new controls (Appendix H) suggest yes, provided they align with the THINK–NOTHINK contrast. Directions estimated from different parts of THINK rollouts reproduce and remove the gain much as does, while length, marker, and random directions do neither (Appendix H; response to Weakness 1 and Question 1). The estimate depends on alignment with the mode contrast, not on the exact extraction recipe.
Response to Reviewer FYFB: Part 3
Response to Weakness 3 and Question 3: We thank the reviewer and agree that re-invoking existing reasoning can be a genuine benefit, particularly when it lowers inference cost (Appendix B.1). The leakage estimate does not diminish a gain; it tells us which claim the gain supports and what it should be compared against. The decomposition in Sec. 6 splits a gain into two parts:
- The leakage part is reasoning the base model already has, now produced in NOTHINK. Its value is efficiency, so the right baseline is base THINK, not base NOTHINK (the in Sec. 6). For example, Qwen3-8B GRPO@500 in NOTHINK keeps about 85% of base THINK's accuracy at about half the tokens. That said, part of this saving may come from the training setup rather than the method: under RL with a fixed generation budget, rollouts that exceed it receive no reward, which implicitly favors shorter outputs.
- The residual part () is what remains once the drift is removed. Under our audit, it is the part that supports a claim of improved direct-answering capability.
This suggests three practical uses:
- Reporting NOTHINK gains. Report response length and the leakage ratio alongside accuracy. Since, under our audit, leakage is linear in drift with one coefficient per model (Sec. 6), the drift alone gives a cheap estimate once that coefficient is known. A NOTHINK gain that doubles response length also changes the cost users expect when they choose NOTHINK. To support such audits, we will release all checkpoints and rollouts.
- Comparing methods beyond accuracy. Two methods with the same NOTHINK accuracy are not equivalent if their leakage differs. At matched accuracy, SFT drifts about twice as far as GRPO (Appendices D.4, G.3), so more of GRPO's gain lies outside leakage.
- Claiming a higher ceiling. A method that only re-invokes existing reasoning will not exceed base THINK across inference budgets; one that raises the attainable level will. Comparing against base THINK across budgets separates the two.
We have expanded Appendix B.1 with these points.
We appreciate your careful reading and thank you for your patience with this long response. If any point remains unclear, please let us know and we will gladly elaborate.
Response to Reviewer FYFB: Part 1
We sincerely thank the reviewer for the constructive and insightful comments. Below we address the comments point by point.
Response to Weakness 1 and Question 1: We thank the reviewer for this question. We agree that vleak is a composite: as a difference of means over complete rollouts, it bundles deliberation with what accompanies it. To test whether the effect reduces to any one of these factors, we added control directions, each built to isolate one factor, and applied both interventions along each on Qwen3-8B (new Appendix H, changes are highlighted in the revised PDF).
Thinking region alone, position- and length-matched. Think-head and think-end are estimated from the thinking region only, contrasting the first (or last) 256 tokens of the thinking block with the first (or last) 256 tokens of the NOTHINK response. This matches position and the number of tokens averaged. Both directions reproduce the gain when added to the base model and remove it when subtracted from the checkpoint, so the main findings hold. Interestingly, think-head gives the strongest steering gain (0.460 against 0.335 for vleak) but no stronger counter-steering loss (0.362 against 0.349). The signal that best induces thinking in the base model thus sits near the start of deliberation, while what post-training installs in the checkpoint is not concentrated there; the drift aligns less with think-head than with vleak (cosine 0.75 against 0.95). How leakage is distributed across the stages of deliberation is an interesting question we leave for future work.
Not length or style. A length direction leaves accuracy unchanged in both interventions. Its counter-steering value of 0.500 is noise rather than a gain: the bootstrap interval includes zero, marker density and response length are unchanged. After checking the rollouts, we found it is concentrated in a few HMMT-Feb problems while AIME25 is unchanged, a pattern more consistent with sampling variation than with a change in reasoning. A direction targeting marker words, nearly orthogonal to vleak, has no effect either. Besides, the clean-answer reference axis, anchored on the answer a THINK rollout writes after deliberation is complete, shows almost no drift (figure 8). The drift that post-training induces also lies mostly along the thinking-derived directions (cosine 0.61–0.95 with the drift), against 0.34 for length and −0.06 for marker.
We do not claim vleak isolates pure deliberation. The effect follows the THINK–NOTHINK contrast and does not reduce to length, position, or style on its own. These controls cover Qwen3-8B only, and we will note this in Appendix H.