- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper suggests the limitations of existing self-distillation by experimentally demonstrating that reasoning traces can be incorrect even when the final answers are correct (Table 2).
Based on this observation, the authors propose Reliability-Aware Self-Teaching (RAST), a distillation method that evaluates the trustworthiness of the teacher's reasoning based on three factors (1) answer confidence, (2) group trace consistency, and (3) teacher reliability. RAST then adjusts the types and strengths of the training signals according to the estimated reliability.
The paper also presents a variety of experiments to investigate whether training models with RAST leads to actual performance improvements.
Critical strengths
They demonstrate several important empirical findings:
- Even when the final answer is correct, the reasoning process can be incorrect.
- Answer confidence and teacher reliability predict different targets.
Critical weaknesses
Major This paper revisit a well-known issue: answer-level correctness does not always imply the correctness of intermediate reasoning steps. Although the paper provides diagnostic analyses of this issue, it does not convincingly demonstrate that the proposed method effectively addresses it. Specifically, the experiments fail to demostrate that RAST framework improves downstream performance.
Minor
- Lack of ablation studies: the separate effects of answer confidence, group trace consistency, and teacher reliability are not evaluated.
- Section 5.4 contains overly detailed descriptions of the statistical analysis and experimental protocol (It would be better written in Appendix to improve readability).
Questions for authors
- Section 3.1; what is "diagnosis tasks" and how authors get the gold label for each process.