- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
OPDX proposes a framework for selecting teachers for multi-domain on-policy distillation. It first constructs domain-specific teacher candidates through supervised fine-tuning followed by successive reinforcement-learning rounds, and augments them with privileged information. A Teacher Suitability Index (TSI) screens candidates according to how much teacher-preferred probability mass is accessible to the initial student. A second stage selects a teacher combination using average TSI and a Cross-domain Penalty Factor (CPF), which measures dispersion in teacher entropy. The selected teachers then supervise a shared student. Experiments across three domains and two model sizes show substantial improvements over the reported baselines.
Critical strengths
- Selecting teachers according to their compatibility with a particular student is a well-motivated direction. The paper provides explicit, inexpensive-to-evaluate selection scores rather than relying exclusively on teacher benchmark accuracy.
- OPDX shows empirical effectiveness and substantial improvements relative to baselines.
Critical weaknesses
- The method introduces a complex, multi-stage pipeline and several coupled design choices without establishing robustness or providing a transferable tuning procedure. The pipeline depends on teacher construction through SFT and multiple RL rounds, privileged conditioning, a calibration set and rollout count, the effective-support threshold, the number of retained candidates, and the trade-off between TSI and CPF. These choices may differ for different model families and be difficult to tune. The paper does not provide sufficient justifications for motivating these designs.
- The evidence does not yet justify the additional selection machinery relative to simpler alternatives. OPDX is a multi-stage process, which introduces training overhead. Compared to simpler learning methods which can be easier to tune, it is unclear whether the gains of OPDX can be justified.
Questions for authors
- How stable are candidate rankings, selected teacher groups, and final performance across calibration-set draws and reasonable changes to the support threshold, retained candidate count, and CPF weight? Were these settings fixed across domains and model sizes, and what procedure selected them?
- What is the total computational and tuning cost, including teacher construction and selection? Is there evidence that compatibility measured against the initial student remains predictive throughout distillation?