- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper separates category-level alignment from within-category imitation in on-policy language-model distillation. SCS-OPD uses category alignment for rollout training and selects auxiliary residuals by comparing category-only and category-plus-residual AdamW trials from identical parameters and optimizer states. It leads AIME24 and MATH500 across three Qwen3 seeds, with exceptions on AIME25 and AMC23, and leads three of four mathematical benchmarks in a second configuration evaluated at seed 17. A single-seed ablation supports residual selection, while local probes characterize residual concentration and interference.
Critical strengths
Principled selective supervision. Sections 4.3–4.4 introduce matched AdamW trials that assess the incremental benefit of residual supervision over category-only updates while accounting for optimizer state.
Encouraging downstream evidence. SCS-OPD leads three of four benchmarks in Table 1, and Section 5.2 reports consistent AIME24 and MATH500 advantages across three Qwen3 seeds. The controlled ablation in Table 2 supports selective residual use at the evaluated setting.
Critical weaknesses
The selector’s benefit is insufficiently isolated. Table 2 evaluates one seed and residual weight, without uncertainty estimates, a tuned uniform-residual baseline, or simpler-selector comparisons.
Local selection is not validated at the aggregate-update level. Section 4.3 selects residuals through individual-pack trials, whereas Section 4.4 commits a joint update. The experiments do not establish whether accepted residuals remain beneficial when combined.
The semantic interpretation lacks direct evidence. Section 4.1 uses lexical rules to approximate semantic equivalence. The perturbations in Section 5.3 preserve category masses by construction, but do not establish contextual interchangeability or show that semantic grouping outperforms simpler grouping rules.
Questions for authors
Clarification: Comparison fairness. Which baselines receive equivalent auxiliary supervision, and how are total training budgets matched? What runtime and peak-memory overhead does SCS-OPD introduce?
Additional evidence: Gate reliability. Could you report acceptance rates over training, the frequency of all-rejected iterations, and decision stability across repeated trials or a small positive gate margin? These would clarify whether the zero-margin selector operates reliably.
Clarification: Result consistency. What run, checkpoint, or evaluation differences explain the discrepancies in Appendix B.3? Was selected using validation data separate from the reported benchmarks?
Clarification: Transfer across configurations. What is the exact 7B teacher checkpoint, and were the grouping rules and selector hyperparameters transferred unchanged? This determines whether the second configuration supports transferability or required configuration-specific tuning.