- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
SRSD uses a diagnosis of the student's rollout and a separate failed rollout to construct positive and negative teachers. It trains the student to follow the positive teacher while moving away from the negative one.
Critical strengths
- The experiments cover mathematics, coding, and tool use across multiple model sizes and families, with substantial reported gains on coding.
- The paper includes useful ablations on the teacher components, diagnosis model, and conditioning information.
Critical weaknesses
- I find the main problem this paper aims to address unclear. The "static reference" issue seems to apply to OPSD, whereas SDPO uses students' own outputs. Is this a general problem in self-distillation? Why is state-relative supervision needed, and what exactly does "state-relative" mean? How does it relate to the static-reference problem and the proposed method?
- All baseline results in the main tables are quoted from prior work. How is comparability guaranteed? This is particularly concerning in Table 2, which combines results from multiple papers without reproducing the key baselines under a common protocol.
- The objective in Eq. (10) needs further justification. Without clipping, can be unbounded below when . How do the authors ensure stable optimization? In Table 3, the smallest positive tested (0.3) performs best, while performs worse at every scale. The results seem sensitive to the choice of , and it is unclear how they support the proposed principle.
Questions for authors
See weakness section.