- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors compare different forms of privileged information (PI) used during self-distillation. The work is rooted in the logic domain with programs verifiable via logic solvers, which provide diagnostic feedback that can be used as PI for the teacher model during self-distillation. Comparing the different forms of diagnostics inserted as PI during self-distillation, the authors find that the models mostly collapse, and with their best setup, they find that self-distillation ties GRPO.
Critical strengths
None
Critical weaknesses
Overall, I find the paper very hard to follow and comprehend. The authors use terminology before defining it, making the text hardly comprehensible. E.g. what do you mean in the abstract with "A sibling’s verified program", "in a matched 30-step pilot", "moving the program between prompt slots changes", "Prover diagnostics cost 18.07 points against the program and teach the defect they complain about", "A pre-run probe of the teacher’s preference margin ranks the verified program first", etc. After reading the abstract, I have little to no understanding of what you are doing in the paper. Further, this continues throughout the paper.
To me, the overall method, contribution, and findings of the paper are unclear. After reading the paper, it remains unclear to me what its main message is.
Questions for authors
What do you want to show with this paper, and what is the main message? And what kind of solver feedback is most valuable for SDPO?