- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
SpecFold reuses QKV and FFN computation across diffusion branches with similar hidden states. Custom kernels handle reuse and partial recomputation. Tests on Fast-dLLM-v2 and Nemotron-Labs-Diffusion show speedups over Spiffy.
Critical strengths
- Reusing work across branches is a useful idea beyond reducing denoising steps.
- The paper shows real speedups on block-diffusion models and includes several useful ablations.
Critical weaknesses
- Accuracy does drop in some cases. On Fast-dLLM-v2-7B HumanEval, it falls from 64.63% with Spiffy to 61.59%. This is a speed–quality trade-off, not lossless acceleration.
- Gains shrink with model size. The best gain over Spiffy on the 14B model is only 1.13x. A runtime breakdown would help show how much the reuse logic itself costs.
Questions for authors
- Do the accuracy drops persist across runs? Can a lower reuse threshold recover quality?
- How much time goes to gating, packing, and looking up reused states?