- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how to integrate specialist LLM capabilities while preserving the reference model’s general performance. WOPD combines verifier-derived, domain-specific specialist weights with a fixed reference weight, using a clamped, sampled-token surrogate of weighted reverse KL on student-generated responses. Experiments on Qwen3-4B show improvements over uniform weighting across five in-domain benchmarks, while reference-removal ablations support improved out-of-domain retention. The analysis characterizes the effective teacher as a geometric pool and reference supervision as KL regularization.
Critical strengths
Substantial gains over uniform weighting. With the same teacher pool and training configuration, WOPD improves all five in-domain scores, including Chemistry by 15.80 points and FinQA by 15.00 points (Table 1).
Evidence for reference anchoring. Reference inclusion improves all five out-of-domain scores by 3.0 to 6.6 points, with in-domain changes within 1.8 points (Table 2). This supports retention without separate preservation prompts.
Critical weaknesses
The allocation benefit is not isolated. Joint five-domain training lacks comparisons against reference-regularized routing and uniform specialist weighting with the same reference share. Tables 3, 4, and 8 use different domains, teacher pools, or training settings and do not resolve this gap. The additional teacher-inference cost is also unquantified.
Reproducibility and reliability remain limited. The main training configuration, advantage clamp, verifier implementations, and in-domain test sizes need clarification. Single-run results without uncertainty estimates weaken the smaller gains and retention claims.
Questions for authors
Clarification: Please specify the main five-domain training hyperparameters, advantage clamp, verifier implementations, and in-domain test-set sizes.
Clarification: How were and selected, and using what data? Table 9’s single-domain, two-teacher study does not establish robustness around the main configuration.
Suggested experiment: Does WOPD outperform modified routing with own-domain specialist/reference weights of , and uniform specialist weighting with per specialist and for the reference, under matched five-domain training settings?
Suggested experiment: Do the main gains and reference-removal results persist across training seeds, with training variability and paired confidence intervals reported?