- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
BWB-KD trains a non-thinking SFT expert, distills it into a fresh base-initialized student using thinking-mode on-policy trajectories, then applies non-thinking GRPO. Three biomedical adaptations show improved domain performance, while the MedXpert branch retains substantially more non-thinking general capability than SFT-based training paths.
Critical strengths
The MedXpert OFF gain over SFT+GRPO is substantial: +5.37 points, with a question-paired 95% CI of [2.82, 8.02] (Table 6). General capability also improves markedly over that path (Table 2). Offline distillation, stage-order, mode, and alternative-RL comparisons probe the design beyond a simple SFT+RL baseline (Tables 3–5). They support separating expert acquisition from final student training.
Critical weaknesses
The advantage over stronger alternatives is less decisive. OFF MedXpert gains are only 1.04 points over FKL+GRPO and 0.91 over Base+DAPO, with lower general means (Tables 3, 5). Comparable uncertainty and end-to-end training-cost comparisons are missing. Evidence is concentrated in one backbone, with general-retention tests only on the MedXpert branch. Reported bootstrap intervals measure question sampling, not training variance (Appendices D–E); the wider robustness of the schedule remains uncertain.
Questions for authors
Do gains over FKL+GRPO and Base+DAPO persist across training seeds and comparable total budgets, including expert acquisition and OPD?
Performance Against Stronger Baselines, Training Cost, and Cross-Task Retention
Thank you for highlighting offline distillation and direct DAPO as strong alternatives. We added three-seed comparisons and extended RL budgets.
Given strong offline FKL and Base+DAPO baselines, is BWB-KD worthwhile?
The main experiments use 100 RL updates. We extended FKL+GRPO to 200 and SFT+GRPO to 400, while keeping BWB-KD and the other methods at their original budgets.
The following results are from Table 14(a). Accuracy is mean ± sample standard deviation over three training seeds (%). Each run selects its checkpoint by OFF validation accuracy and evaluates that model in both modes.
Costs include expert acquisition, distillation, teacher services, and RL, excluding loading, saving, and independent evaluation. Offline FKL+GRPO uses a different GPU configuration but has similar output lengths, so its RL cost uses BWB-KD's reference step time, scaled to 200 updates. DAPO uses timing measurements from the 32-GPU configuration.
Extended FKL+GRPO costs more than BWB-KD, yet BWB-KD remains ahead by 0.58 points in OFF and 1.23 in ON. Extending SFT+GRPO from 100 to 400 updates improves OFF accuracy by only 0.52 points and ON by 0.29, leaving gaps of 5.05 and 0.87 points. Giving the additional computation to RL does not replace expert-guided transfer on student-generated trajectories.
Both routes retain OFF general ability well. Their difference in ON reasoning appears before RL: offline FKL scores 70.50 on BBEH, below Base's 83.25, while the OPD student reaches 83.50. After RL, BWB-KD exceeds the original 100-update FKL+GRPO baseline by 2.88 points in ON general mean, including 14.00 points on BBEH.
Offline FKL fits fixed teacher trajectories. OPD instead provides expert guidance along the student's current reasoning trajectories. The results support this form of transfer as a way to integrate domain knowledge while preserving the student's general reasoning ability.
At similar total cost, BWB-KD exceeds Base+DAPO by 1.91 points in OFF and 3.98 in ON across three seeds. In the main experiment, it also generates 43.0% fewer tokens in OFF and 28.2% fewer in ON.
Thus, using part of the budget for expert-guided transfer before RL gives stronger domain performance and shorter outputs than direct RL. Appendix G, Tables 13–14, reports stage-wise costs and the repeated-run results.
General capabilities after adaptation to other tasks
We evaluated all five adapted training paths from each task, together with Base, in both inference modes. To reduce API costs, ArenaHard uses DeepSeek V4.1 Flash instead of GPT-5.4, and Base is reevaluated as well. All methods share the judge and scoring procedure.
The columns group models by adaptation task and inference mode. Each entry is the general-benchmark mean over AIME25, ArenaHard, BBEH, and IFBench. Appendix J, Tables 18–19, gives individual scores. The judge budget is 32K and the ON BBEH context is 128K.
The SFT paths lose OFF general performance on both tasks, and subsequent GRPO does not recover it. BWB-KD improves over SFT+GRPO by 5.21 points after BioASQ adaptation and 10.53 after MedCaseReasoning adaptation. Its mean across the two branches is 64.66 in OFF and 75.38 in ON, close to Base's 64.08 and 75.51. ON performance is broadly similar across methods; the main difference is in OFF.
Retention is already present before RL. The OPD students score 63.72 and 63.89 in OFF, both close to Base. Combined with the domain gains, this shows that expert-guided transfer followed by RL preserves general ability while improving domain performance. Base+GRPO also retains general ability, but its domain results are below BWB-KD. The retention finding therefore extends beyond the MedXpert branch.