- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies capability distillation under a fixed token budget and proposes ReAD, a framework that dynamically allocates teacher supervision across interdependent capabilities. ReAD combines task-conditioned capability priorities with an uncertainty-aware contextual bandit, rewarding task-aligned gains while penalizing regressions in prioritized capabilities. Experiments across eight capabilities, two teacher–student pairs, and two token budgets show improved target performance and reduced negative transfer.
Critical strengths
- The paper is clearly written, with well-organized and informative figures and tables.
- The evaluation is extensive and carefully controlled, covering multiple capabilities, model pairs, budgets, seeds, matched allocation baselines, and component ablations.
- The paper introduces a well-motivated formulation of teacher-guided target distillation that allocates part of a fixed budget to auxiliary capabilities when cross-capability transfer is beneficial.
Critical weaknesses
- Despite the extensive evaluation, the paper does not compare with closely related online skill- and data-mixture methods such as Skill-It, leaving the benefit of ReAD’s specific allocation design relative to prior approaches unclear.
- ReAD depends on a predefined capability taxonomy, a learned priority vector, and a fixed probe suite, but its robustness to misspecified signals and its scalability to finer or previously unseen capabilities remain unclear.
Questions for authors
- Could the authors adapt Skill-It or another online data-mixture method to the same teacher–student setting and compare it with ReAD under matched token and generation budgets?
- How sensitive is ReAD to errors in the inferred capability priorities or noisy probe measurements, and how does performance change as the number of candidate capabilities increases?
- How consistent are the learned cross-capability relationships and allocation policies across model families and token budgets?