- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes HoltSeer, a training-free diffusion model acceleration method. It addresses the issues of sparse feature calculation and prone-to-false prediction of features under high acceleration. The method draws inspiration from the Holt exponential smoothing. The horizontal state summarizes recent features, the trend state describes the direction of change, and the scaling coefficient controls the extrapolation amplitude. The predicted features participate in subsequent updates and are periodically refreshed through the complete network calculation. The main contribution is to combine these designs into a lightweight feature predictor, which reduces network computation while better preserving the original full-step sampling results. The experiments cover FLUX.1-dev, Qwen-Image, and Wan2.1, including image and video generation tasks. The evaluation uses DrawBench and VBench2 prompts, comparing inference latency, computation volume, and generation result fidelity. The improvement under high acceleration settings is more obvious. The paper also conducts prediction feedback control, window size, and parameter sensitivity experiments. Overall, the results support the full method in improving reference fidelity under large cache intervals. However, the existing ablation studies have not fully separated the role of the smoothing mechanism from other designs.
Critical strengths
The fidelity improvement is significantly enhanced under high acceleration, and there is evidence of matching the computational budget. Under the N=10 setting of Qwen-Image, the report delay and FLOPs of HoltSeer and TaylorSeer are the same, but SSIM increases from 0.4635 to 0.7242, and LPIPS decreases from 0.6128 to 0.4191. This indicates that, at least in this setting, the benefits do not come from increasing the computational load, but rather better preservation of the full-step sampling results at the same cost. This is the most compelling evidence supporting the acceptance of the paper. It reflects the actual speed - fidelity improvement, rather than just intuitive design in terms of method. The application value of the method has been cross-model verified, and the additional memory overhead is low. The main experiments use the same set of smoothing and trend scaling parameters, covering FLUX.1-dev, Qwen-Image, and Wan2.1, including image and video generation tasks. This enhances my confidence in its applicable range, not just the effectiveness on a single model. At the same time, the paper reports on two image models, with only an increase of 0.14 GB and 0.17 GB of memory on the original baseline. This makes its performance improvement more clearly have deployment significance, and is another core basis for my positive evaluation of this work.
Critical weaknesses
The incremental value of the core smoothing design has not been fully verified. Equation (10) indicates that when K = 2, the two smoothing parameters completely cancel out, and the method degenerates into a simple two-point damping extrapolation. However, in Table 6, under the FLUX.1-dev and N = 6 settings, this simplified version of SSIM and LPIPS are superior to the main configuration K = 3. The existing parameter sensitivity experiments have not independently separated the effects of smoothing and damping. Therefore, the experiments support the effectiveness of the complete scheme, but have not yet explained how much additional value the core smoothing design provides compared to the simple damping extrapolation. This directly affects my judgment of the contribution strength of the method, and is the main reason for rejecting the manuscript. There is a substantial logical gap in the theoretical motivation. Proposition 3.2 deduces a scaling relationship between the adjacent network outputs from the local smoothness assumption, but local smoothness does not guarantee this relationship. The authors also explicitly acknowledge this condition limitation. This does not invalidate the reported experimental benefits, but weakens the theoretical basis of the method. Combined with the insufficient mechanism verification, it makes me still inclined to reject the manuscript.
Questions for authors
- How much independent gain does the smoothing mechanism provide compared to trend damping? Please explain whether there are fixed window size, trend scaling coefficient, refresh schedule, and calculation budget, and only change the control results of the smoothing mechanism. Especially in the case of the most advantageous Qwen-Image with N=10 settings, which evidence can distinguish "the gain brought by smoothing" from "the gain brought by reducing the extent of extrapolation"?
- What necessary conditions does the scalar scaling relationship in Proposition 3.2 depend on? Assuming that Proposition 3.1 only requires local smoothness of residual features, Proposition 3.2 further provides a scaling relationship between adjacent network outputs. Local smoothness itself does not guarantee this conclusion. Please explain whether there are additional unmentioned assumptions and provide the key derivation to obtain this error order. Also, please clarify how to transition from the smoothness of the internal residual features to this relationship between network outputs, and which conclusions in the actual algorithm and subsequent error analysis rely on this proposition.
Dear Reviewers,
As we are approaching the end of reviewer-author discussions, please go through authors' responses and raise questions that you would like authors to reply.
Thanks,
AC