- Rating
- 1(−1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studied how to use reasoning trace instead of final answer to train the student model. the reasoning trace is defined and also proposed an improvement of using frozen-student target selection process to improve the student model training.
Critical strengths
I agree with the position of this paper. I think the reasoning traces should be used instead of only using the answer-only supervision. The proposed frozen-student target selection process seems interesting, although there are concerns about the experiments.
Critical weaknesses
while I agree with the motivation of this paper - to use the reasoning trace rather than answer only, but the claimed contributations are weak and cannot convince me. The formulation and evaluation principle are not new, if I don't call it straightforward or simple. I feel the authors just tell the readers that there is a problem, and here is what I did, and this is results. I cannot get the insight or new findings from the paper. The experiment setup does not clearly isolate the gain from the proposed reasoning trace. In the frozen-student target selection process, it seems the principle of using the traces which lead the right answer as the training target is contradictory with the overall assumption -- use the reasoning trace rather that the answer. Also, it is not guaranteed that the traces with the correct answer are valid reasoning trace.
Overall, I feel the problem defined in this paper makes sense, however, the experiment design and results cannot support the conclusion clearly.
Questions for authors
see the weakness.
6 comments
Response to Reviewer RSGd (2/2)
Weakness 2: Isolating the gain from the proposed traces
Response:
We agree. Table 1 alone does not isolate the contribution of the traces, because its Answer-only and Original Trace rows also differ from ReDiST in which questions are trained on and how often each is seen. The revision adds two controlled comparisons, each changing one factor (Table 12).
(1) Remove the trace. Following Eq. (1), the control trains on exactly the same examples as ReDiST, seen equally often, with the same templates, loss rule and number of updates. Only the trace is removed (one seed-matched pair). The ReDiST traces add 13.8 points on 2Wiki [10.7, 16.9], while MuSiQue differs by 1.5 points [−1.3, 4.4]. The gain from the trace itself therefore appears on 2Wiki and not on the source task, and the source-task advantage over Answer-only in Table 1 reflects the complete recipe.
(2) Remove the student's draft. Fresh rewrite gives the rewrite model the same question and evidence but not the student's draft. Table 2 compared one such run with the Table 1 run (a 20.3-point gap on 2Wiki). We now train it twice, each time alongside a full ReDiST run with the same questions, settings and seed. 2Wiki EM falls by 9.1 [6.5, 11.8] and 14.6 [11.9, 17.4] points in the two pairs, and MuSiQue and HotpotQA change by at most 2.7 points, with intervals that include zero. The matched gaps are smaller than in Table 2, and both intervals exclude zero. In both pairs, conditioning the rewrite on the student's draft is worth at least 9 points on 2Wiki. Section 4.3 now reports the matched numbers.
Training seeds. Three training seeds of the full recipe give 0.686, 0.691 and 0.694 2Wiki EM, and Table 10 also reports three training seeds for five baselines, of which the strongest on 2Wiki, MBT-R, averages 0.646.
Together, the two controls distinguish the benefit of including the constructed traces from the benefit of conditioning their construction on the student's draft, under the stated training protocols.
Weakness 3: Answer-based selection and trace validity
Response:
We understand why this looks contradictory, and Section 3.2 now states the two roles explicitly: in target selection, the verified answer is used only to choose among candidate traces for the same question, and the student is then trained on the selected trace followed by that answer.
Why answer-based selection is not answer supervision. All candidates for a question share the same verified answer, so the choice among them depends only on the traces. A frozen copy of the student reads each candidate; among those from which it recovers the verified answer, the one with the highest verified-answer probability is kept. A candidate that fails this check is one that this student cannot yet follow to the answer, so we prefer a candidate that passes (if none passes, we keep the student's own answer-correct draft or fall back to answer-only supervision). Selecting reasoning traces by their outcome is common practice when building reasoning supervision, e.g., STaR (Zelikman et al., 2022) and rejection-sampling fine-tuning (Yuan et al., 2023, arXiv:2308.01825). That the trace, and not the answer, carries the 2Wiki gain is shown by the paired control: removing the traces from exactly the same selected examples lowers 2Wiki EM by 13.8 points [10.7, 16.9] (see our response to Weakness 2).
A correct answer does not make a trace valid. We agree, and passing the check does not certify the intermediate steps (Section 3.2). This is why ReDiST edits the drafts against the supplied evidence, and why we now audit the selected targets directly (Appendix C, Table 13). For the MuSiQue-supervised Qwen3-8B targets, a judge model (Gemma-3-27B-IT) that sees only the question, the evidence and the trace labels each claim as supported by the evidence or not. In targets built from answer-correct drafts, 1.7% (draft kept unchanged) to 3.8% (draft edited) of the claims are unsupported, close to the 2.5% of the original student traces. Repaired traces, which start from failed drafts and are written with access to the verified answer, are worse at 13.3%. We keep them because they are what makes failed attempts usable: when the failed drafts are used as targets instead, 2Wiki EM falls by 6.0 points and HotpotQA EM by 5.7 (Table 2, single run). The Conclusion states the lower support of repaired traces as a limitation.
Two further checks examine answer recovery and process coverage. With every mention of the answer masked, the traces still raise the frozen reader's answer recovery from 50.9% (no trace) to 75.8%, so they carry usable reasoning beyond the answer string. In addition, 96.4% of ReDiST targets state every sub-answer of the question's annotated decomposition, compared with 78.8% of the original student traces.
Follow-up on our response
Dear Reviewer RSGd,
Thank you again for your thoughtful comments. We wanted to follow up on our responses, particularly the paired trace-removal and fresh-rewrite controls (Table 12), the trace audit (Table 13), and our clarification of how answer-based selection relates to trace supervision.
We would appreciate your feedback on whether these results clarify the contribution of the constructed traces and address your concerns. Please let us know if there are further questions we can help address.
Best,
Authors of Paper #3359
Response to Reviewer RSGd (1/2)
Weakness 1: Contribution and insight
Response:
Thank you for this candid assessment. The submission contained relevant results (Figure 1, Sections 4.2 and 4.3), but their implications were not stated clearly, and the matched measurement called for by Eq. (1) was not reported. We also agree that the premise is not new: prior work has shown that a trace which accompanies a correct answer need not be a good teaching target, and the paper starts from it. The revision states three measured findings in the Introduction and in the new Conclusion, supported by the original comparisons and the additional controlled experiments.
1. Source-task accuracy does not reveal which supervision transfers. Trained on MuSiQue, the Answer-only recipe reaches 0.562 MuSiQue EM, within 2.2 points of ReDiST (0.584). Its 2Wiki EM in Table 1, however, is 0.479 (0.461 and 0.456 with two further training seeds), which is below the untrained model (0.516) and 20.7 points below ReDiST (0.686). The same pattern holds for every student in Table 3: for all four, the Answer-only recipe has the lowest 2Wiki EM of all trained variants, and for three of them it falls below the untrained model. These results show that a small source-task difference can accompany a much larger transfer difference, making source-task accuracy insufficient for assessing supervision intended to generalize across benchmarks.
2. Under a paired control, the traces add nothing measurable on the source task and 13.8 points on 2Wiki. We now report the paired control of Eq. (1), which keeps the same examples, exposure, templates and update budget and removes only the traces (one seed-matched pair). The ReDiST traces add 13.8 EM points on 2Wiki [10.7, 16.9], while MuSiQue EM differs by 1.5 points, with an interval that includes zero ([−1.3, 4.4]). The source-task advantage of ReDiST over Answer-only in Table 1 is therefore a difference between complete recipes, and the measurable effect of the traces is on 2Wiki. The same holds for other rewritten traces: MBT-R, whose training set differs from the Answer-only row by only five questions, is 18.1 points above Answer-only on 2Wiki and about 1.4 on MuSiQue, averaged over three training seeds (Table 10).
3. Where the trace comes from matters, and so does choosing among candidates. Replacing the draft-conditioned edit with a fresh trace written by the same rewrite model from the same evidence lowers 2Wiki EM by 9.1 and 14.6 points in two seed-matched pairs, with no significant change on MuSiQue or HotpotQA. Draft conditioning is shared with MBT-R, which also rewrites the student's attempt, and with a single rewrite per question the two methods have the same 2Wiki EM (0.633; Table 11). What ReDiST adds to draft-conditioned rewriting is the generation of several candidates and the choice among them by the frozen student, which raises 2Wiki EM to 0.686. These comparisons support both retaining the student's draft as the starting point and exploring alternative edits within the proposed selection procedure. The scope of the candidate-budget comparison is detailed in our response to Reviewer F6Ye, Weakness 2.
On the formulation. The evaluation principle is deliberately minimal, and we do not claim a paired trace-removed control as a new idea. Its role is to separate what a trace adds from what answer supervision already provides. The submission stated it without applying it; the revision applies it (finding 2). The methodological contribution is the construction procedure: ReDiST starts from the student's own attempts, including failed ones, edits them against the supplied evidence, and prefers the candidates from which a frozen copy of the student recovers the verified answer. The findings above explain why these construction choices matter: their effects can be substantially more visible in cross-benchmark transfer than in source-task accuracy.