- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes WMSS, a supervised fine-tuning framework that uses a model's weaker historical state to guide further training under the original reference targets. WD-DS selects examples using current predictive entropy and historical entropy differences, while WD-JT mixes historical and current logits before computing cross-entropy. The paper derives local gradient and margin identities and evaluates the method on mathematical reasoning, code generation, and logical reasoning across four Qwen and Gemma backbones. Results show consistent improvements over SFT and several offline baselines, with additional multi-seed math results, component ablations, and optimization controls. Inference uses only the final strong model.
Critical strengths
-
The empirical improvement is broad and reasonably well supported. Tables 1–3 show gains across four backbones and three task domains. In Table 2, the three-run math averages improve from 63.3 to 69.9 on Qwen3-4B and from 65.8 to 73.1 on Qwen3-8B. Fixed main-run coefficients and preselected training endpoints strengthen the evidence that the method offers a reusable improvement over SFT. This breadth is the strongest reason for acceptance.
-
The paper offers a useful mechanism with meaningful controls. Section 5 separates correction scale from redistribution toward historical alternatives, while Section 6.4 tests larger learning rates, label smoothing, a uniform reference, and shuffled weak-logit pairings. The combined method outperforms these controls and both component-only variants. Together, these results support the value of sample-aligned historical predictions and provide a practical way to use them without additional deployment cost.
Critical weaknesses
-
The efficiency comparison does not fully establish an advantage at matched compute. Section 6.2 and Appendix D.5 acknowledge roughly 1.2× SFT computation despite fewer updates. The longer-SFT diagnostic is not a matched continuation: its near-two-epoch MATH500 score is 59.6, versus 66.2 for the main SFT baseline. Consequently, that trajectory does not settle whether a comparably configured SFT run given the additional budget would close some of the gap. This limits the strength of the efficiency interpretation, although the reported wall-clock overhead is modest.
-
The strongest mechanism controls have narrower coverage than the main performance claim. Figure 6 tests alternative explanations on one backbone and three math benchmarks, while the repeated-seed comparisons also focus on Qwen3 mathematics. Code, logic, and Gemma results are useful evidence of transfer, but do not establish equally robust component attribution in those settings. The local logit identities also do not guarantee favorable full-network updates, as Appendix E acknowledges. The broader mechanistic interpretation should remain conditional on this scope.
Questions for authors
-
Clarification: What configuration or seed differences explain the 59.6 versus 66.2 near-two-epoch SFT discrepancy? Is there an existing continuation from the main baseline that permits comparison at WMSS's actual compute or wall-clock budget?
-
Clarification: Are additional training-seed results or uniform/shuffled-reference controls already available for code, logic, or Gemma? Please distinguish these from the multi-seed math evidence rather than undertaking a new experimental campaign.
-
Clarification: Is the historical branch frozen throughout each WD-JT stage, and is the factor λ left in the implemented loss gradient or compensated in the optimizer? This would connect the local analysis and the compute accounting more precisely to the training implementation.
A kind request before the discussion closes
Dear Reviewer 2Jnp,
We are sorry to write once more, and we understand how busy this period is.
Your comments have been a great help to us. Your questions showed us where the paper was not precise enough, and working through them has made it clearer and stronger. We are grateful for the care you put into the review and for your positive assessment of our work.
The discussion closes soon. If you could find a few minutes to read our rebuttal and leave a short reply, we would be truly grateful. Even one line on whether your concerns have been addressed, or on what remains open, would mean a great deal to us. If anything is unclear, we will reply right away.
Thank you sincerely for your time.
Best regards,
The Authors