- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes two-stage data selection for reasoning SFT. Teacher trajectories are ranked by disagreement in final-answer correctness among continuations from intermediate steps. Correct trajectories with high uncertainty form a candidate pool. Student response losses then select a smaller training subset. Experiments cover multiple student families, weak-to-strong transfer, and API-only teachers. The paper reports comparable or better reasoning performance with student sample exposure as low as 0.22% of full-data SFT. This figure excludes teacher-side uncertainty profiling.
Critical strengths
The comparison within the same pool of correct teacher responses is useful. In Table 4, uncertainty-based selection improves the seven-benchmark average by 1.6–4.5 points over random selection. This is more informative than comparing only against full-data SFT. Reusing one teacher profile across different student families is also a useful design choice.
Critical weaknesses
- The student-side savings are substantial, but the practical cost advantage remains unclear.
- The learner-routing procedure is described inconsistently. Section 2.3 says scores and the active subset are updated during training. Appendix E instead fixes the subset and sampling weights after the first epoch.
Questions for authors
- What rollout count and total teacher-profiling cost were used?
- Which routing procedure produced the reported results: adaptive rescoring or the fixed subset in Appendix E?
- Please clarify: Does Table 3 represent one checkpoint? Its entries match the per-benchmark maxima across Table 1. In particular, AIME25 = 93.3 and HMMT25 = 90.0 occur at different retention ratios.
3 comments
Reply
Your answer has answered some of my questions. I will increase my score.Thank you
Dear Reviewer iJG9,
We would like to express our sincere gratitude for acknowledging our work and providing constructive feedback. Thank you again for your time and effort in reviewing our manuscript.
Dear Reviewer iJG9,
Thank you for the careful review and constructive suggestions. We appreciate your recognition of our work's strengths, e.g., strong reasoning performance, extensive experimental results, and useful method design.
We provide responses to address the comments below:
1. As suggested, we first provide a practical cost analysis of the complete pipeline on both Qwen3-8B/1.7B teachers (Table C-1), covering offline teacher profiling (2 rollouts) and online student training. Importantly, due to our decoupled design, the teacher-side profiling incurs only a one-time, student-agnostic cost, and can be reused across student training runs. Moreover, Table C-2 further compares our complete pipeline with full-data SFT. Even under this minimal reuse, training just one 4B/9B student using a shared profile, our method achieves 15.2%–15.8% end-to-end cost savings. Furthermore, Table C-3 demonstrates that the additional profiling cost is fully amortized after only two student training runs, with further reuse yielding increasing cumulative savings, highlighting our practical efficiency.
2. To fully address your comment, beyond GPU-hour accounting, Table C-4 further evaluates actual response-token consumption, total non-padding tokens, and training GPU-hours. At ρ=1%, our method processes only 0.016% of response tokens and 0.019% of total non-padding tokens compared with full SFT, which validates the practical value of amortizing teacher-side profiling across learners.
We have included these additional results in Appendix K on pages 30-31 of the revised manuscript and will publicly release the uncertainty-profiled reasoning data to facilitate broader reuse.
Table C-1: The wall-clock GPU hours using Qwen3-8B/1.7B as the teacher on a 4-H200-GPU server. We report CPU hours on supervision contraction.
Table C-2: End-to-end computational cost comparison between full SFT and Ours for one training run per student.
Table C-3: Amortized computational efficiency and break-even analysis.
Table C-4: Token-level computational efficiency for Qwen3.5-4B across contraction ratios.
Q3/4: Clarification on the learner-routing procedure.
A3/4: Thanks for pointing this out. We would like to clarify that we perform learner-aware routing after the probing epoch and use this selected active subset for the remaining two epochs to avoid additional rescoring overhead. We have clarified this in Sec. 2.3 and Appendix E of the revised manuscript.
Q5: Clarification on Table 3.
A5: Thanks for pointing this out. We clarify that all results in Table 3 are from a single Qwen3.5-9B checkpoint (ρ=30%). We have corrected the HMMT25 accuracy from 90.0% to 86.7% in Table 3 and clarified the checkpoint configuration in the caption of the revised manuscript.