- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper extends on-policy self-distillation with a dynamically updated teacher and an auxiliary objective that learns from concise, verified rewrites.
Critical strengths
The method is well motivated, and the experiments include useful ablations on teacher updates, reference-solution placement, and generation budgets.
Critical weaknesses
See Questions For Authors
Questions for authors
Could the authors train and evaluate OPSD and DCE+SRCL in thinking mode, comparing them with the original thinking-mode model under matched generation budgets?
2 comments
Thank you for running the thinking-mode experiments. While DCE+SRCL improves over OPSD, its gains over the original thinking models are small, particularly at 4B. I therefore maintain my original score.
Response to Reviewer QZQP
We thank you for your thoughtful feedback and for recognizing the motivation of our method and the usefulness of the ablations on teacher updates, reference-solution placement, and generation budgets. We address your concern below.
W1: Training and Evaluation in Thinking Mode
We reran the experiments in thinking mode, training and evaluating OPSD and DCE+SRCL on Qwen3-4B and Qwen3-8B and re-evaluating the original models under the same protocol. DCE+SRCL outperforms OPSD by 3.68 and 8.38 percentage points at 4B and 8B, respectively.
Qwen3-4B
Qwen3-8B
The gains over the original models are smaller than in our main non-thinking experiments: +0.09 points at 4B and +2.71 points at 8B. We hypothesize that thinking mode already elicits stronger reflection from the student, leaving less room for improvement through teacher co-evolution. This interpretation is consistent with our non-thinking training curves, where most gains emerge by around step 50 and subsequent improvements are smaller (Figure 3, page 8).
If our responses have addressed your concerns, we would appreciate it if you could reconsider your score. We are happy to provide any further clarification if needed.