- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an acceleration method for diffusion transformers that requires no gradient-based training. It computes a fixed subset of denoising steps and approximates the skipped transformer outputs as linear combinations of previously computed outputs. The predictor uses either polynomial least-squares extrapolation based on the computed step indices or closed-form calibration over a small collection of full trajectories. The paper also develops gap-bounded schedules and studies the relative effects of step selection and predictor design.
The central empirical claim is that step selection has a greater influence on image-text alignment than the predictor variants tested, while forecasting and calibration can improve sharpness on PixArt-alpha. Experiments report approximately 2.3-2.9x wall-clock speedups on PixArt-alpha and a 3.39x operating point on SD3.5-Medium. The latter uses 4-bit weights and a 28-step flow-matching trajectory, whereas PixArt uses 20 DDIM steps. The paper includes probes across sampling budgets, resolutions and solvers, as well as calibration-size and seed ablations. Although CLIP alignment is largely preserved at the selected operating points, the sharpness trade-off is appreciably larger on PixArt than on SD3.5.
Critical strengths
- Simple method with low inference overhead.
The method leaves the pretrained model weights and the surrounding solver unchanged. A skipped step requires only a weighted sum of cached outputs, and calibration uses a small closed-form solve. This makes the approach practically attractive and provides a useful low-cost reference for studying diffusion caching.
- Useful controlled experiments across two architectures.
The paper separates scheduling from prediction and includes fixed-schedule comparisons of predictor variants, calibration-size studies, multiple seeds, and replication on SD3.5-Medium. These experiments provide useful evidence about where quality changes arise. The inclusion of sharpness diagnostics and ImageReward also helps expose degradation that CLIP alone may miss.
Critical weaknesses
- Limited methodological novelty and overly broad conclusions.
L2P already learns linear combinations of historical features. Closed-form fitting is a useful simplification, but the methodological advance appears incremental. This makes the attribution study particularly important. The experiments, including the comparison at matched wall-clock cost, support the selected schedules against the gates tested, but do not establish that fixed schedules generally outperform adaptive methods or that predictor design is secondary across caching approaches. Clearer positioning relative to recent methods such as TAP, SeaCache, SVD-Cache and LESA is needed to establish the scope and added contribution.
- Unclear calibration protocol for the attribution study.
Section 3.3 states that calibrated weights are shared across schedules, yet Eq. (3) depends on the selected steps and history indices. It is unclear whether the numerical weights are reused or refitted for each schedule. This distinction matters for the attribution study: refitting can change the predictor alongside the schedule, while reusing weights across different histories requires justification.
Questions for authors
-
Calibration protocol (clarification): Were the numerical weights held fixed across schedules and computed-step budgets, or was Eq. (3) solved separately for each schedule using the same calibration trajectories? Please reconcile the schedule dependence of Eq. (3) with the reuse statement in Section 3.3. If the weights are reused, how are changes in the history indices handled?
-
Schedule selection and data separation (clarification): The paper describes residual screening followed by direct rendering. What criterion determines the final operating point after rendering, and which prompts and seeds are used for this selection? Please distinguish the data used for coefficient fitting, schedule selection and final evaluation, and clarify whether these sets overlap.
-
Scope of the attribution claim (evidence affecting the assessment): Could the authors provide a representative comparison with a recent adaptive method such as SeaCache or TAP at comparable wall-clock cost, or explain any adaptation barriers and narrow the general conclusion accordingly? Please also discuss how SVD-Cache and LESA affect the claim about the relative importance of predictor design, accounting for their different preparation costs.
-
Benefit of the estimator (evidence affecting the assessment): Beyond the reported comparison of prediction residuals, under an identical schedule and prediction target, does an end-to-end comparison with Taylor-style forecasting show a meaningful difference in final image quality? Such a control would help distinguish the practical contribution of the estimator from that of the selected schedules; it need not demonstrate that least squares is superior if the intended contribution is primarily the attribution study.