- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes UQ-Commit, which alternates GRPO with teacher-correction SFT and selectively adopts the corrected checkpoint. Adoption requires a lower bootstrap quantile of the paired validation pass@32 improvement to exceed a fixed margin. Across three training seeds, the primary 4B study reports gains of 2.25 Macro6 points over always accepting correction and 2.18 over GRPO, with additional schedule and scale comparisons.
Critical strengths
-
Separating correction generation from checkpoint adoption is a useful design choice. The primary comparison holds the teacher, correction recipe, and GRPO schedule fixed, providing evidence for selective adoption beyond simply adding teacher supervision.
-
The experimental reporting is appropriately cautious. It reports three training seeds, separates independent cohorts, and explicitly limits the interpretation of pass@32 and bootstrap thresholds under validation reuse. The primary improvement over GRPO is positive in all three seeds, with supporting results at 8B.
Critical weaknesses
-
The contribution of uncertainty-based selection is not isolated. The main comparison is against always accepting correction, while UQ-Commit accepts only 16 of 24 candidates. There is no comparison against a simple mean-improvement gate or a random/fixed-frequency policy with a comparable adoption rate. Consequently, the gain could come from ordinary validation selection or reduced correction frequency, rather than the bootstrap criterion. The paper acknowledges this limitation, but it remains central to assessing the method’s distinct contribution.
-
The performance gain is not evaluated against the substantial additional computation. Assessment generates 307,200 extra sequences per primary run (Table 5), approximately 29% of the configured GRPO rollout count, before counting teacher generation and correction SFT. No measured token totals, GPU-hours, or comparison at equal total computational cost are provided. The reported 2.18-point Macro6 gain over GRPO therefore does not establish whether this is a competitive use of the additional budget.
Questions for authors
-
How does UQ-Commit compare with a mean-difference gate and a random or fixed-frequency correction policy matched to its adoption rate, using the same correction recipe?
-
What are the measured token and GPU-hour costs, and does the gain persist when the baseline receives the same total computational budget? How much can the assessment budget be reduced while retaining the benefit?