- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Factorial On-Policy Distillation (FOPD), which identifies token-level supervision that remains consistent across plain and privileged teacher contexts. The method compares base and final teacher predictions under both contexts and retains checkpoint-induced preference directions that agree across contexts and align with standard OPD.
Critical strengths
-
The paper addresses an important problem of identifying reliable token-level supervision in on-policy distillation.
-
The proposed method is relatively simple and can be incorporated into existing OPD frameworks without changing student rollout generation.
-
The experiments demonstrate consistent improvements across multiple benchmarks and model configurations.
Critical weaknesses
-
The central motivation for cross-context consistency is insufficiently justified.
- The paper assumes that teacher preferences that vary across contexts are less reliable. However, privileged information is intended to provide additional knowledge unavailable in the plain context. Therefore, context-dependent changes in teacher preferences may represent useful supervision rather than noise. It is unclear why agreement between plain and privileged contexts should be preferred over the privileged teacher's judgment.
-
A critical privileged-only distillation baseline is missing.
- Since FOPD introduces both privileged information and cross-context consistency filtering, the current comparisons cannot isolate the contribution of the proposed consistency mechanism.
-
Computational efficiency and statistical reliability require further evaluation.
- FOPD evaluates four teacher-scoring configurations, potentially increasing training overhead relative to OPD2. However, compute-matched comparisons and detailed wall-clock measurements are missing.
-
The presentation quality of the figures needs substantial improvement.
- Figures 1 and 2 are overcrowded with text, mathematical notation, and visual elements. Their small font sizes make the main ideas difficult to follow.
Questions for authors
Please check the weaknesses above.
Dear Reviewer,
Thank you so much for your thoughtful initial reviews!
With only two days left before the discussion window closes, I wanted to send a friendly reminder to check out the authors' rebuttal. They have put a lot of effort into answering the specific questions you raised.
Whenever you have a spare moment today, please drop a brief reply in the thread to let the authors know if their responses have addressed your concerns, or if any questions remain. Your timely feedback makes a huge difference in ensuring a fair and constructive review process!
Warm regards