- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
REPAIR-OPD learns from successful repairs of student-generated responses. A teacher proposes a local token replacement, the student regenerates the suffix, and a bounded search retains responses accepted by a Judge. These repairs are paired with the original failures for BCE training, with an additional unlikelihood penalty against repetition. Experiments show improvements mainly on mathematical reasoning, with further tests on smaller Qwen and Llama models.
Critical strengths
-
The method changes which trajectories are collected for training, rather than only selecting supervision positions on an existing rollout. Combining local teacher guidance, student continuation, and outcome verification gives a concrete and potentially useful training procedure. (§3, pp. 3–5)
-
The main results include a meaningful matched-seed comparison. REPAIR-OPD improves the overall score over TA-OPD in all three seeds, with respective means of 54.55% and 49.02%. The smaller-Qwen and Llama results provide some additional support for the method’s applicability. (Tables 1–4, pp. 6–7)
Critical weaknesses
-
The experiments do not isolate the value of the teacher-selected intervention. Repair also introduces additional sampling, Judge filtering, and a different training objective. Without matched resampling controls, it is unclear how much the local replacement contributes beyond these other changes. The large UL ablation effect also makes comparisons with baseline-plus-UL important. The results support the complete procedure, but provide weaker evidence for the proposed explanation of its gains. (§3.3, p. 4; Figures 3–4, pp. 7–9)
-
Some evidence central to the repair process needs clarification. The Judge’s prompt, acceptance criteria, and calibration are not sufficiently documented. Separately, Appendix D.1 contains a confirmed presentation inconsistency: the displayed response changes before the marked intervention, although Equation (4) requires that prefix to remain unchanged. This could reflect editing of the example; it does not by itself establish an implementation error. Raw traces are needed to resolve the discrepancy. (Equation (4), p. 4; Appendix D.1, pp. 16–17)
Questions for authors
-
Can you compare teacher-token replacement with retaining the original token and resampling the suffix at the same position, using the same generation budget, Judge, BCE objective, and UL penalty? A budget-matched full-response resampling comparison would also help establish the value of localized repair.
-
Please provide the Judge’s prompt, acceptance rule, and any calibration results. How are the “answer correct, reasoning invalid” cases in Figure 7 handled? Please also specify the GPQA-D evaluation denominator and aggregation procedure, and β in Equation (6). (pp. 4, 12–14)
-
Is Appendix D.1 an unedited generation trace? Please provide the original token sequence and intervention index, or identify any presentation edits that explain the changed prefix. (pp. 16–17)
3 comments
Thanks for your responses
Thank you for the additional experiments and clarifications. The additional resampling controls and OPD/TA-OPD + UL comparisons substantially strengthen the empirical evidence. The clarifications on the Judge protocol and evaluation also address my earlier concerns. I therefore raise my final rating from 2 to 3.
We really appreciate your thoughtful comments, which helped us identify issues in our paper and improve our work. Thank you again for your time and valuable suggestions!
Thank you & Looking forward to further discussion
Dear Reviewer nhM3,
Thank you again for reviewing our paper and for asking about the resampling controls, the Judge, and the repair trace.
The full results and clarifications are in our rebuttal. We would appreciate hearing whether they address your concerns and would be happy to discuss any remaining questions.
Warm regards,
Authors