- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how longer reasoning affects whether reasoning models accept or reject user requests. Across ten open-weight models, the authors find that later reasoning prefixes tend to increase acceptance of harmful requests and false premises, and they attribute this partly to self-generated justifications that shift the model’s stance. They further propose SC-OPSD to reduce this acceptance drift by introducing an independent verification signal and distilling it into the model.
Critical strengths
- The paper is well-motivated. It provides clear examples of the motivation issue.
- The paper is easy to understand.
- The performance of the proposed method is good.
Critical weaknesses
-
The claim of “thinking longer” is somewhat narrower than the paper’s framing. The model does not independently generate trajectories under different reasoning budgets; instead, the authors truncate a single completed trajectory at different points and resample the final answer. This establishes the effect of exposing the answer policy to a longer prefix of the same reasoning trace, rather than the effect of naturally allocating more inference-time compute.
-
The generalization to frontier reasoning models remains unclear. The paper only evaluates 10 open-weight models which are relatively small and weak compared wtih frontier models such as GPT-6-Astra. It is therefore unclear whether the same phenomenon persists in stronger frontier models with different safety mechanisms. This limits the scope of the paper.
-
The detailed results show heterogeneity that is partially obscured by the averaged results. In particular, GPT-OSS-20B and GPT-OSS-120B show the opposite trend on harmful acceptance, and GPT-OSS-120B also shows decreased false-premise acceptance with longer reasoning. There is a lack of more specific discussion on this condition.
-
The explanation remains largely behavioral rather than mechanistic. While the paper shows that self-generated justifications can causally shift final answers through removal and insertion interventions, it does not identify the internal mechanism that produces or propagates this stance change during reasoning. The current evidence is better viewed as a behavioral account of the phenomenon rather than a mechanistic
-
The method contribution feels relatively limited compared with the empirical part of the paper. SC-OPSD appears largely as an application of existing OPSD with a different form of privileged teacher context, rather than a novel method. More importantly, the mitigation method does not further explain or validate the core phenomenon of reasoning-induced acceptance drift, so this section feels somewhat disconnected from the paper’s main scientific question.
Questions for authors
-
Does the observed acceptance shift persist when “thinking longer” is induced by genuinely larger inference-time reasoning budgets, rather than by truncating different prefixes of the same completed reasoning trajectory?
-
Does the observed relationship between reasoning length and acceptance generalize to substantially stronger frontier reasoning models with different post-training and safety mechanisms?
-
What explains the substantial cross-model heterogeneity in the effect of longer reasoning, particularly the reversed trend observed in GPT-OSS-20B and GPT-OSS-120B?
-
What internal mechanism causes longer reasoning to shift the model from withholding to acceptance?
-
Does SC-OPSD provide a technical contribution beyond applying existing OPSD, and does it reveal anything new about the mechanism underlying acceptance drift?