- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SSR, a training-free method that drafts a response from a partial chain of thought while the same model continues reasoning, then reuses the draft through prefix verification and suffix decoding to accelerate the final response. Across three model families on ClassEval, SSR reports 1.23–1.55× end-to-end speedups over standard decoding. Compared with suffix decoding, the additional draft provides approximately 8.3% and 6.1% gains on Gemma and Qwen, respectively, while GPT-OSS shows no statistically clear incremental gain.
Critical strengths
1.Drafting from partial reasoning introduces candidate content not yet present in the context, extending the sources available to text-reuse methods.
2.SSR reuses model weights and prefix caches without training a separate drafter, while suffix reuse recovers useful content beyond the first prefix mismatch.
Critical weaknesses
1.SSR mainly introduces a new draft source, with limited methodological advances; targeted system-level optimizations could help deliver more substantial acceleration.
2.SSR only accelerates final responses, yet provides approximately 6–8% additional speedup over already model-free suffix decoding on Gemma and Qwen, despite requiring extra full-model drafting.
3.Omitted residual correction, filtered quality results, and a single ClassEval timing run without warmup leave quality preservation and performance robustness insufficiently established.
Questions for authors
1.What capabilities does partial-CoT drafting offer beyond SparseSpec and SuffixDecoding, and which workloads demonstrate substantial benefits?
2.What additional GPU time and memory does drafting require, and does its advantage over suffix decoding persist under concurrent workloads?
3.Do the incremental gains persist with residual-corrected verification, full-task quality evaluation, and repeated timing measurements?