- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes using a small draft model in speculative search and train itself during a single problem. It remembers previously finished attempts through an add-on attention layer and learns from two signals: matching the large model's predictions, and imitating attempts that scored well. The paper shows that this can keep the large model’s outputs unchanged, which also means the extra training can't directly improve answer quality, only speed. It then lays out an experiment plan but reports no experiments.
Critical strengths
None
Critical weaknesses
- Despite being a method paper, no empirical evidence is provided and none of the central claims is tested.
- The method simply assembles known components like LoRA test-time training, verification-feedback loss, etc. The novelty is limited.
Questions for authors
- A single MATH or AIME problem yields relatively few completed rollouts. Can they meaningfully improve the draft model?
- Section 6 makes accuracy at a matched FLOP budget the primary metric, with wall-clock time only secondary. However, the known benefit of speculative decoding is lower latency, not fewer FLOPs. Why choose FLOPs rather than latency as the primary budget?