- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes DG-CFG, a training-free guidance schedule motivated by a path-integral characterization of deterministic CFG. It combines inverse diffusion-rate weighting, signal-content weighting, and low-noise attenuation while matching an integrated guidance budget. Experiments include analytic toy distributions and Stable Diffusion models with different samplers and sampling budgets.
Critical strengths
The path-integral characterization provides a useful perspective on time-dependent CFG. The method is easy to implement, and the analytic experiments, component ablations, and NFE sweeps provide evidence for improved stability under strong guidance.
Critical weaknesses
-
The connection between the analysis and the proposed schedule remains partly heuristic. Equation (17) contains a state-dependent term evaluated along a guidance-dependent trajectory. Canceling its explicit diffusion-rate coefficient does not equalize the actual distributional contribution across time. The additional signal and attenuation factors are plausible, but the analysis does not establish why this particular combination should offer a better trade-off than other schedules.
-
The experiments establish robustness at high guidance more clearly than superiority over well-tuned alternatives. At moderate guidance, DG-CFG can have worse FID; on SDXL at guidance 7, it obtains 76.79 versus 72.86 for constant CFG and 72.29 for β–CFG. Interval boundaries and the beta profile are fixed rather than systematically tuned. Comparing the best attainable quality–diversity trade-offs would be more informative than emphasizing equal nominal guidance. Evaluation on 1,000 COCO prompts without uncertainty estimates also makes small differences difficult to assess.
Questions for authors
- Can the analysis justify the specific schedule beyond balancing the explicit coefficient, or should it be presented as a theory-motivated heuristic?
- How do the methods compare after independently tuning guidance strength and schedule parameters under equal tuning budgets? Can uncertainty estimates be provided for the main FID and diversity comparisons?
Q1. Theoretical justification of the specific schedule
Thank you for your careful review and this important question about the scope of the theoretical justification. We expanded the analysis to derive the specific schedule by maximizing an efficiency lower bound in a two-component Gaussian mixture model, beyond balancing the explicit temporal coefficient.
- From the density analysis to an allocation criterion. Theorem 4.3 identifies ht=β(t)(ω(t)−1) as the explicit temporal coefficient in the accumulated density correction. We then specify a fixed guidance budget, ∫t0T(ω(t)−1)dt=B, and a common noise-prediction perturbation constraint. Theorem 5.1 establishes an efficiency lower bound balancing distributional response against perturbation risk:
\frac{(\int_{t_0}^T a_th_t\,dt)^2}{\int_{t_0}^T h_t^2/\sigma_t^2\,dt}, \quad a_t=\sqrt{\bar\alpha_t},\quad\sigma_t^2=1-\bar\alpha_t.$$ 2. **Derivation of the full schedule.** By Cauchy-Schwarz, this lower bound is uniquely maximized by $h_t^*=c_Ba_t\sigma_t^2$, where $c_B$ enforces the budget. Substituting the definition of $h_t$ yields DG-CFG: $$\omega(t)=1+C(\bar\omega-1) \frac{\sqrt{\bar\alpha_t}(1-\bar\alpha_t)}{\beta(t)}.$$ The signal and noise factors are thus jointly supported by the efficiency-bound optimization, providing justification beyond balancing the explicit coefficient. 3. **Scope of the claim.** The result maximizes the stated lower bound in the two-component model. It motivates the schedule for practical diffusion models as stated in Sec. 5.3. We retain time balancing, signal-content weighting, and low-noise attenuation as intuitive interpretations of the resulting schedule. **Revision locations:** Secs. 5.1-5.3, pages 5-7; Theorem 5.1 and Eqs. (21)-(22), page 6; proof in Appendix B.3, pages 21-25. Revisions are highlighted in blue. ## Q2. Independently tuned comparisons and uncertainty estimates Thank you for raising these important questions about tuning fairness and statistical uncertainty. **We added comparisons at method-specific guidance strengths and bootstrap standard errors for the main metrics, including FID and diversity.** 1. **Tuning protocol.** We evaluate SDXL with DDIM and Euler at 8 steps. DG-CFG introduces no hyperparameters beyond $\bar\omega$. For baselines, we use parameters recommended in the original papers. When recommendations are unavailable, we tune these parameters by grid search on a small sample subset. This provides broadly comparable tuning budgets across methods. With these parameters fixed, we sweep the same guidance-strength grid and select method-specific configurations by jointly considering ImageReward (IR), CLIP, and FID. 2. **Tuned results.** After method-specific tuning, DG-CFG retains the highest observed perceptual quality (ImageReward) and text alignment (CLIP) among the selected configurations with both samplers. These gains come with slightly higher FID, clarifying DG-CFG's advantage for perceptual quality and prompt alignment. Key comparisons are below. Table 3 includes all baselines. | Sampler | Method | $\bar\omega$ | FID | CLIP | IR | |---|---|---:|---:|---:|---:| | DDIM | $\beta$-CFG | 11 | 70.65 | 32.06 | 0.350 | | DDIM | DG-CFG | 19 | 73.57 | 32.10 | 0.417 | | Euler | C\$^2\$FG | 11 | 70.36 | 31.84 | 0.316 | | Euler | DG-CFG | 19 | 73.34 | 31.91 | 0.402 | 3. **FID and diversity uncertainty.** We now report bootstrap SEs from 200 resamples, using matched real-generated image pairs for FID and per-prompt Vendi scores for diversity. Diversity is averaged over 100 prompts, each with 16 samples from different initializations. **Revision locations:** Sec. 6.2.3, pages 8-9, and Table 3, page 9 (tuned comparison); Appendix D.1, page 28 (uncertainty protocol); Table 2, page 8, and Tables 7-9, pages 29-30 (main FID and diversity results with SEs); Table 10, page 34 (Euler results with SEs). Revisions are highlighted in blue.