- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies whether teacher supervision in OPD includes fluctuations caused by changes in context. It calls changes in the teacher's likelihoods on fixed student tokens TSD. The authors examine this sensitivity through contextual interventions involving instructions, evaluations, answers, and solutions, and use these observations to propose Cal-OPD. Cal-OPD scores the same student trajectory using the original teacher prompt and prompts with positive and negative evaluations to estimate a teacher likelihood interval for each token. If the student's likelihood falls within this interval, the distillation advantage is set to zero. Otherwise, only the signed residual beyond the interval boundary is retained. Experiments compare Cal-OPD with standard OPD and its variants across two Qwen3 teacher and student configurations and six mathematics benchmarks. The paper also examines intervention types, the interval relaxation factor, and signal filtering strategies.
Critical strengths
- The calibration rule is clear and easy to understand. In Table 3, Cal-OPD achieves the highest average mathematics accuracy in both teacher and student configurations, supporting the practical value of this selective supervision approach.
- The main text provides a useful analysis of intervention types and calibration strength. Comparisons across contextual interventions and ablations of the relaxation factor show that excessive calibration can filter out useful supervision, helping clarify when the method is appropriate.
Critical weaknesses
- My main concern is that the link between TSD under evaluative interventions and unhelpful supervision remains insufficiently supported. The authors acknowledge that calibration using solution-level interventions can remove task-relevant information. For the positive and negative evaluative interventions used in the main method, however, similar likelihood changes and their concentration on connective tokens do not establish that the attenuated signals are unhelpful for planning or error correction. The results support the effectiveness of the calibration rule, but attributing the gains to removing unhelpful teacher fluctuations requires more direct evidence.
- Evaluation covers only mathematics tasks and the Qwen3 family. It remains unclear whether the evaluative interventions and calibration gains transfer to other tasks or model families, so the scope of the conclusions needs to be clearer.
Questions for authors
- For the evaluative interventions used in the main method, could you provide more direct evidence that the attenuated signals are unhelpful for learning? For example, you could analyze how these signals relate to subsequent reasoning correctness in existing trajectories, or test whether semantically similar paraphrases of the evaluation prompts produce stable intervals and training gains. This would also help clarify the limits of the proposed interpretation of TSD.
- Could you discuss when evaluative interventions would be appropriate for non-mathematical tasks or other model families, whether the prompts would need adjustment, and how these considerations limit the conclusions? If preliminary results are already available, one representative setting would be helpful.