- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces OPSRD, a reference-free, on-policy self-role distillation method that investigates whether expert role prompting can still provide effective training supervision even when it fails to directly improve answer accuracy. The method employs a frozen version of the same base model as a "role teacher" to provide next-token distributions over reasoning prefixes generated by the student model; distillation is performed using truncated forward KL divergence and high-entropy position selection, thereby enabling the student to perform inference without role prompts. Experiments conducted across three model sizes (based on Qwen3) and three competitive mathematics benchmarks demonstrate that the method improves average accuracy, while ablation studies further analyze the effects of role positioning, distillation objectives, and supervision density.
Critical strengths
-
This paper discusses the distinction between the direct utility and teacher value of role prompting. When the role of math expert was directly applied to Qwen3-1.7B, it yields no improvement; however, employing this role for distillation-based supervision on the teacher side did enhance student performance.
-
The proposed OPSRD method achieves an average accuracy exceeding that of the base models across the Qwen3-1.7B, 4B, and 8B variants, as well as on the AIME 2024, AIME 2025, and HMMT 2025 mathematics benchmarks.
Critical weaknesses
-
The independent contribution of the expert persona was not fully isolated. The expert prompt not only established the identity of a "mathematics expert" but also mandated identifying key structures, verifying steps, reconsidering questionable branches, and checking answers. The performance gains may stem from these specific reasoning instructions rather than the expert persona itself. Although the neutral teacher matched the "thinking" template and message placement, it did not match the instruction length and reasoning requirements.
-
Mechanistic explanations for the core phenomenon remain largely speculative. The authors argue that the "role-model" teacher provides information about "preferences for the next token that are useful but invisible to full-answer evaluation," yet the primary evidence stems from the final accuracy achieved after distillation. The paper does not directly verify whether the candidate tokens boosted by the teacher are indeed more correct or correspond to critical reasoning steps, nor does it confirm whether students consequently make fewer specific reasoning errors.
-
The experiments covered only the Qwen3 model family, mathematical tasks, and three benchmarks. It is recommended to conduct experiments on large-scale models from various model series and to test tasks with verifiable outcomes, such as code generation.
Questions for authors
See Weakness