- The central motivation is promising but remains exploratory, and the distinctive role of behavioral traits is not fully identified.
The broad proposal is that behavioral traits can become reusable privileged supervision for reasoning. However, the actual truthfulness instruction emphasizes checking uncertain steps, correcting mistakes, and avoiding unsupported conclusions. The planning and exploration variants likewise give concrete procedural reasoning advice. The current evidence therefore does not clearly distinguish learning a behavioral trait from distilling generally useful reasoning instructions. This matters because the novelty is framed around traits as a new supervision source rather than simply around adding a reusable reasoning prompt to an on-policy self-teacher.
The otherwise matched solution-answer PI ablation at 1.7B is a meaningful positive control, and the paper does not need to demonstrate that conventional OPSD is intrinsically flawed. What remains unclear is the additional value of the trait-based formulation relative to a comparably specific, non-trait reasoning instruction. Appendix A.3.6 also shows that direct truthfulness substitution in OPSD helps at smaller scale but underperforms solution-conditioned OPSD at 8B (approximately 77.1 versus 78.5), indicating that supervision content and training design interact. A sharper hypothesis about why these behavioral instructions should provide a transferable teaching signal, along with a focused control or analysis, would substantially improve the paper's motivation and contribution statement.
- The stance gate has empirical support, but its relation to beneficial student updates is still indirect.
Stance measures how an instruction changes the EMA teacher's likelihood of the observed student trajectory. It is not a step-level measure of correctness, and the subsequent student update compares the student with the instructed EMA teacher rather than comparing the teacher's two conditioning states. The sign of the stance-outcome score therefore need not identify a beneficial direction of change for the student. In particular, negative-weight JSD can move the student away from an instructed teacher even when that teacher assigns a lower probability to an erroneous token than the current student does. Applying the same signed weight to an entire response also cannot distinguish sound intermediate reasoning from incorrect or redundant steps within that response.
These are limits of the proxy, not evidence that the method fails. Figure 3(d) finds that weak negative weights outperform zero or positive alternatives, and Appendix A.3.5 provides gate statistics. A direct diagnostic showing how updates in different gate categories change correct-answer probability or task outcomes would clarify why this simple rule works and under what conditions, particularly as the EMA teacher diverges from the current student.
- Main-run gains are attributable to the whole training recipe, not yet cleanly to the proposed supervision source.
The main τ-OPSD configuration uses one rollout and one optimizer update per question batch, whereas the baselines use eight rollouts per question and four optimizer updates per step, together with differences in objective, teacher updating, and normalization. The component ablations demonstrate which choices matter within τ-OPSD, but the main-table margin over OPSD cannot by itself be attributed to behavioral-trait conditioning. The matched solution-answer PI comparison partially addresses supervision-source attribution at 1.7B, and should be acknowledged, but the full baseline comparison still bundles general optimization choices with the new guidance and gate. It would help to more explicitly separate the claims supported by the matched PI ablation from those supported only by comparisons of complete training recipes. The stated speedups remain valid as per-step measurements under the respective configurations, rather than equal-budget efficiency claims.
- The abstention transfer result would benefit from a focused reliability check.
The GPQA-Abstain subset contains only 40 answerable–unanswerable pairs but contributes one-third of the unweighted abstention macro-average. Its relatively large gains drive an important part of the overall F1 advantage, particularly at 1.7B and 4B. Additionally, judgments use a fixed Qwen3-8B evaluator for Qwen3-family models, without a reported independent-model or human audit. This does not demonstrate evaluator bias, but a targeted verification of the GPQA cases driving the improvement would make the claim more convincing. The authors already avoid interpreting these results as proof of general honesty or truthful intermediate reasoning, and I agree with that narrower interpretation.
Response to Reviewer Ec9W
We sincerely thank the reviewer for recognizing the practical value of reusable behavioral traits as privileged supervision and the consistent improvements in mathematical reasoning and abstention across model scales. We appreciate the constructive suggestion to better isolate the contribution of trait-induced stance.
To W & Q. Disentangling Trait-Induced Stance from Outcome-Based Weighting
We agree that the original w/o stance gate ablation alone cannot disentangle these effects. To address this, we introduce two additional controls under the same τ-OPSD training configuration on Qwen3-1.7B.
We compare these controls with the original uniform-weight ablation and the full τ-OPSD method.
The results demonstrate complementary contributions from outcome-based weighting and trait-induced stance. Correct-only improves average accuracy over uniform weighting by 0.74 points, while outcome-only further improves it by 1.46 points. Crucially, the full τ-OPSD achieves an additional 1.43 points gain over outcome-only, outperforming it on all three benchmarks. The overall improvement over uniform weighting reaches 3.63 points.
These matched comparisons provide direct empirical evidence that trait-induced stance contributes beyond correctness-based supervision alone, rather than attributing the entire gain to outcome-aware weighting.
Furthermore, Appendix A.3.5 (Figures 6–7) provides complementary training-dynamics analyses of positive/negative supervision, hard-sample weight allocation, and effective sample size, illustrating how the stance gate adaptively regulates supervision throughout training.
We have incorporated the new controlled ablations and analyses into revised Section 4.2 (page 8) and Appendix A.3.1 (page 20). Together, these results support the distinct empirical contribution of trait-induced stance within our framework.