- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes centered-history on-policy distillation (OPD), a randomized horizon estimator for OPD after the student model generates prefixes. The core idea is to preserve the mean of the semi-gradient for a specified full horizon while intermittently evaluating response tails. All rollouts in the same batch first generate to a common prefix boundary, after which they share a random decision to either continue reasoning or stop the responses. For the decision to stop a response, a parameter-space vector b is used to predict the omitted subsequent response. The paper also characterizes the additional covariance, the role of causal centering, and the distinction between expected retained work and runtime. Experiments on MATH with Qwen3-0.6B and Qwen3-1.7B show that, compared with plain OPD accuracies of 60.333% and 74.623%, centered-history OPD achieves accuracies of 61.662% and 75.410%, respectively.
Critical strengths
1.The method has some degree of novelty. The estimator is clearly constructed and technically meaningful. 2.The paper clearly characterizes, in theory, the relationship among computational cost, tail-prediction error, continuation probability, and variance. 3.The experiments provide preliminary evidence that centered-history OPD can improve accuracy.
Critical weaknesses
1.The main claim of the method should concern resource savings rather than accuracy improvement, yet the final experimental design measures only accuracy, making the experimental setup highly unreasonable. 2.The experimental setup is overly cursory, using only one benchmark and one teacher; the experimental evidence is insufficient to support the effectiveness of the method. 3.Necessary ablation experiments are missing, making it impossible to determine the contribution of each component. 4.The experimental setup is not sufficiently comprehensive and lacks detailed information such as random seeds, response-level results, and question-level confidence intervals. 5.The theoretical guarantee remains limited to the raw semi-gradient at a single step before clipping.
Questions for authors
1.Please provide more detailed experimental settings, including random seeds and other parameters, as well as more detailed results on resource consumption, GPU-hours, and related costs. 2.Please compare the method with more baselines under comparable experimental conditions. 3.Please add ablation and analysis experiments to examine the various claims about the method and its theoretical proof in greater detail