- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Allspark, a framework for weak-to-strong transfer through alternating chains of thought. During training, a weak teacher is trained with reinforcement learning alongside a frozen copy of the same model. During inference, the frozen copy is replaced by a stronger student, while both models remain fixed. Experiments on Qwen and ARC-AGI-2 show improvements in several settings, including cross-family transfer.
Critical strengths
The appendix provides lots of case studies across math, reasoning, and coding, illustrating how teacher-generated reasoning affects student outputs.
Critical weaknesses
-
The paper seems to have been completed in a rush. The main text is seriously insufficient and falls far short of the 9-page limit. Pages 6 and 7 are occupied by three figures, leaving a large amount of blank space.
-
The authors seem to deliberately blur the distinction between OPD and on-policy self-distillation (OPSD). In this paper, both the student and the teacher are set to the model itself, yet the authors still emphasize “weak teacher” and “strong student.” There is a major logical problem here.
-
Based on Point 2, the experimental baselines do not include OPSD methods. The number of experiments, the choice of benchmarks, and other aspects are seriously insufficient and unconvincing.
Questions for authors
See Weaknesses.