- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Dynamic Drift-Aware Guidance (DrAG), a training-free approach that accelerates classifier-free guidance (CFG) by caching and dynamically reusing the displacement between conditional and unconditional predictions (the guidance-gap) across sampling steps. To decide when the cached guidance-gap becomes stale and requires recomputation, the authors develop two variants: DrAG-Spatial, which tracks directional alignment and magnitude divergence of the conditional velocity in the spatial domain, and DrAG-Spectral, which leverages low-pass Fourier filtering to isolate low-frequency structural drift from high-frequency fluctuations. Extensive experiments on T2I generation demonstrate that DrAG significantly cuts down redundant unconditional evaluations without compromising sample fidelity or prompt alignment. In addition, the authors validate the transferability of this mechanism across text-to-video, few-step, and score-based diffusion models, as well as training-time acceleration for one-step Drifting generative models.
Critical strengths
-
Clear Presentation and Solid Theoretical Grounding: The paper is well-written and easy to follow. The proposed method is simple, elegant, and intuitive, supported by rigorous theoretical error bounds (Proposition 1 and Corollaries 1–2) that link guidance-gap approximation error to observable conditional velocity drift.
-
Insightful Guidance-Gap Caching Mechanism: Formulating CFG acceleration as dynamic guidance-gap reuse—rather than freezing stale unconditional predictions or relying on rigid step schedules—is insightful. Both the spatial and spectral drift-aware refresh criteria are well-motivated and reasonable.
-
Comprehensive Evaluation Across Modern Backbones and Baselines: The experiments cover diverse mainstream T2I architectures (FLUX.1-dev, Qwen-Image, and SD3) and compare against recent CFG-acceleration baselines (Step-AG, THG, and AG), achieving strong performance across most evaluation settings.
-
Extension to One-Step Model Training: Beyond multi-step inference acceleration, the authors successfully extend the core spectral drift principle to skip redundant negative feature-encoder evaluations during the training of one-step Drifting models, demonstrating strong versatility.
Critical weaknesses
-
Marginal Advantage Over AG on Qwen-Image: In Table 1, DrAG does not demonstrate a clear advantage over Adaptive Guidance (AG) on the Qwen-Image backbone. Specifically, AG achieves a higher compute reduction (41.6% vs. 36.8% for DrAG-Spatial and 38.5% for DrAG-Spectral) while outperforming DrAG-Spatial on the overall GenEval2 score (37.86 vs. 37.35) and trailing DrAG-Spectral by only 0.22 points (37.86 vs. 38.08). The authors should provide a more detailed explanation for this behavior.
-
Unaligned NFE Budgets in Quantitative Comparisons: In Table 1, different acceleration methods are evaluated at noticeably different average NFEs (e.g., ranging from 33.0 to 42.0 NFE on SD3, and 36.6 to 45.3 NFE on FLUX). Without strictly aligning the NFE budgets across methods, it is difficult to establish a completely fair, apples-to-apples quality comparison.
-
Ad-Hoc Quality–Efficiency Ranking vs. Pareto Frontier: The custom Quality–Efficiency Ranking in Table 2 relies on ordinal ranks and a manually selected weight of , which is not a standard evaluation metric and feels somewhat arbitrary. For a fairer and more informative comparison, the authors should provide Quality vs. NFE Pareto frontier curves by sweeping the thresholds/hyperparameters of each method.
-
Lack of a Conceptual Method Diagram: Section 3 lacks an illustrative overview figure comparing the pipelines of standard CFG, fixed-schedule skipping, DrAG-Spatial, and DrAG-Spectral. Including a clear schematic diagram of the guidance-gap caching and refresh workflow would improve the paper's readability.
-
Missing Wall-Clock Latency and Batched Inference Analysis: The main text reports theoretical NFE reductions in Table 1 without comparing actual end-to-end wall-clock latency. First, DrAG-Spectral performs discrete Fourier transforms (FFT) and low-pass filtering on high-dimensional velocity tensors at every step, and this computational overhead should be explicitly quantified. Second, because refresh steps are triggered dynamically per prompt, during batched inference (), different samples within a batch will require unconditional evaluations at asynchronous steps. It is unclear how the method avoids this synchronization bottleneck ("straggler effect") to achieve actual wall-clock speedups in batched deployment.
Questions for authors
Please refer to the weaknesses detailed above. I am open to raising my score if the authors can satisfactorily address these concerns during the rebuttal.