- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Spectral Correction Guidance, a training-free method for improving classifier-free guidance (CFG) in diffusion models. The core idea is that the power spectra of intermediate denoising states can indicate whether a guided trajectory remains consistent with the forward process. Accordingly, the authors first derive an analytic reference spectrum from a power-law model of natural-image spectra (Proposition 1), then progressively correct the Fourier magnitude of the current latent toward this target spectrum via phase-preserving log-spectral interpolation. The method is applied only at sampling time and requires no model modification or retraining. The authors validate it on text-to-image generation with SDXL, PixArt-α, and SD3.5, and on class-conditional ImageNet generation with DiT-XL/2, covering standard/high/low guidance scales, multiple sampling budgets, stylized generation, human preference, and multi-seed robustness experiments, reporting consistent gains in FID, IS, and preference metrics.
Critical strengths
- The method is training-free and plug-and-play, adding only ~1.7–2.6 s per image, and reports consistent gains across four backbones and on both text-to-image and class-conditional tasks. It also includes an output-only correction ablation (which helps isolate the contribution of in-trajectory correction) and a human preference study with randomized left-right placement.
- The diagnostic perspective is novel and the analytic formulation is clean and well motivated. Framing guidance quality as alignment between reverse-state spectra and forward-process spectra is a genuinely fresh and interpretable angle compared to timestep-scheduling or geometry-constraint methods; Proposition 1 gives a closed-form target spectrum from the power-law image model, avoiding simulation of forward states; the log-spectral interpolation is simple (per-frequency rescaling by the ratio R_t(ω), phase-preserving), and empirical support for the power-law assumption in latent space is provided with R² > 0.99.
Critical weaknesses
- The core diagnostic claim rests solely on correlational, single-setting evidence. The claim that spectral distance indicates guidance quality is the foundation of the paper, yet its only support is Figure 2, where spectral distance is correlated with FID/IS on a single backbone (SDXL) with 1,000 COCO prompts. Moreover, Eq. 6 compares aggregate spectra rather than per-sample distances, and the paper does not test whether reducing spectral distance by other means also improves the metrics (no causal control experiment). The lack of cross-setting validation of the central mechanistic claim directly undermines my confidence in the source of the gains and the generalizability of the method.
- The hyperparameter λ is tuned per backbone and spans two orders of magnitude, with no selection rule. λ ranges from 0.005 (SiT) to 0.1 (SD3.5) to 0.5 (JiT), about two orders of magnitude, and the paper provides no validation-based or automated selection protocol. This makes it impossible to distinguish between "spectral alignment drives quality improvement" and "per-backbone tuning fits the benchmarks," weakening my assessment of the method's intrinsic generality.
- The relaxation schedule ρ is only described qualitatively, with no formal definition. ρ is mentioned only qualitatively as "relaxed in the late denoising stage" in the main text and Figure 8; no functional form or timestep threshold is given in the main text.
- Table 6 and Table 1 differ by an order of magnitude for SDXL and this is unexplained. Table 6 reports FID ≈ 66.6 and sFID ≈ 344, while Table 1 reports FID ≈ 17 and sFID ≈ 48 for the same model, with no explanation of differences in prompt sets, resolutions, or evaluation protocols. This makes me doubt whether the remaining table values are comparable across experimental settings.
- The anomalous sFID of LF-CFG on SD3.5 in Table 1 is not discussed. LF-CFG achieves sFID = 12.61, far below all other methods including the proposed one (49.07), yet the text only generically states that TV-CFG and LF-CFG achieve lower metrics. Without discussion, one of the paper's main selling points, the magnitude of FID/sFID improvement, is undermined by an unexplained outlier, which may even suggest that sFID and visual quality are decoupled in this setting.
- The timestep distribution in the expectation of Eq. 6 is unspecified (uniform? what weighting?). In Appendix F, the vanishing of the cross-term requires ẑ₀ and ϵ̂ to be uncorrelated at each frequency, but the main text only states this informally as "z₀ ⊥ ϵ and E[ϵ] = 0" without rigorous justification for Fourier coefficients. These gaps in the foundation of the analytic derivation reduce my assessment of the theoretical rigor.
- Algorithm 1 introduces ε for numerical stability, but neither the main text nor Appendix E defines it or gives its value. Though a minor issue, omitting implementation details undermines reproducibility for a method that emphasizes "plug-and-play."
- Baseline hyperparameters are set by the authors, and tuning budgets are unclear. Baselines such as CFG++ (w/12.5) and the TV-CFG schedule use hyperparameters chosen by the authors; the paper does not report how many configurations were tried for the baselines, nor was any baseline tuned with the same effort as the proposed method. If the baselines are undertuned, the reported relative improvements may be overstated, which directly affects my trust in the strength of the experimental conclusions.
Questions for authors
- Does the relationship between spectral distance and FID/IS hold on other backbones (e.g., PixArt-α, DiT) and under different noise schedules? If additional experiments are not possible, can you at least explain why this relationship is expected to be universal?
- How were λ (0.005 to 0.5) and the bin count selected for each backbone? Is there a validation-based protocol? If a sensitivity analysis is performed around the optimal λ, how quickly does performance degrade?
- Why do the FID/sFID for SDXL in Table 6 differ by roughly an order of magnitude from those in Table 1? How do the two differ in prompt set, resolution, and evaluation protocol?
- LF-CFG's sFID on SD3.5 (12.61) is far below that of your method (49.07). How do you interpret this gap? Does it suggest that sFID and visual quality are decoupled in this setting?
- What is the value of the numerical stability constant ε in line 8 of Algorithm 1? How is the timestep distribution in the expectation of t in Eq. 6 defined?
4 comments
Response to Reviewer nMah [2/3]
1.C. From distribution-level consistency to individual trajectory correction
We complement the distribution-level diagnostic in Eq. 6 by measuring how SCG changes spectral deviations in individual sampling trajectories. We follow the default SDXL settings in Appendix E and apply spectral correction during steps 1–25 before relaxing the correction during steps 26–50. The analysis uses 1k real COCO images and 50 paired CFG and SCG trajectories generated using the same prompts and seeds.
We encode the real images into VAE latents and forward-noise them to match the sampling noise levels, providing a baseline for natural sample variation. Eq. 6 measures the distance between expected spectra. This analysis instead computes the mean of individual distances to the shared timestep-dependent reference. For each sample and timestep, we compute the mean squared log-power discrepancy across radial bins and then average these distances over samples and timesteps. This captures deviations that can be masked when spectra are averaged before computing the distance. The comparison examines whether SCG reduces the mean magnitude of these individual deviations toward the level observed in real forward states.
| Sampling steps | Real-image mean distance | CFG mean distance | SCG mean distance | Reduction from CFG |
|---|---|---|---|---|
| 1–25: correction applied | 0.01370 | 0.03614 | 0.01545 | 57.25% |
| 26–50: correction relaxed | 0.07301 | 0.17474 | 0.09605 | 45.03% |
| 1–50: full trajectory | 0.04335 | 0.10544 | 0.05575 | 47.12% |
SCG brings the mean spectral deviation of individual sampling trajectories closer to the level observed in forward-noised real images. During steps 1–25, the distance decreases from 0.03614 to 0.01545, approaching the real-image baseline of 0.01370. During steps 26–50, the distance remains 45.03% lower than CFG after correction is relaxed, showing that early correction influences the subsequent evolution of individual samples. Across the full trajectory, SCG brings the mean distance from 0.10544 to 0.05575, closer to the real-image baseline of 0.04335. The distribution-level consistency criterion guides correction of individual sampling trajectories toward the spectral consistency expected from the forward process.
2. Parameter selection and generality across backbones (W2, Q2)
SCG combines a shared spectral criterion with an adjustable degree of correction to accommodate different sampling dynamics and guidance settings. The parameter λ controls the fraction of the log-spectral discrepancy corrected at each step (Eq. 9). Backbone-specific values adjust the degree of correction without changing the criterion or correction formulation. We set λ through coarse ablations using representative correction ratios such as 0.01, 0.05, 0.1, and 0.5. We inspect the generated images to assess the balance between correcting guidance artifacts and preserving sample-specific detail. Figure 7 compares representative correction ratios of λ = 0.005, 0.05, and 0.5. Section 6.2 shows that weak correction leaves outputs close to CFG and excessive correction can introduce artifacts. The bin counts are chosen with respect to the spatial dimensions of the latent representation and specified in Appendix E. Appendix N examines their effect on spectral correction.
The evidence for the shared criterion extends beyond experiments involving backbone-specific λ settings. The cross-backbone CFG analysis in W1/Q1 provides empirical support for the criterion on PixArt-α and SD3.5 without applying SCG or selecting λ. The controlled interventions provide complementary evidence for the contribution of correcting toward the reference at fixed backbone and guidance settings. These experiments support the applicability of the spectral criterion across backbones, alongside the ablations that guide the choice of correction degree.
3. FID/sFID evaluation settings (W4, Q3)
Table 1 uses 10k generated images for the main evaluation (Section 6), and Appendices I and J use 1k images for supplementary analyses and ablations. Table 6 reports the mean and standard deviation across 10 seeds, using 1k images for each evaluation. The image resolution, real-image reference, and sampling parameters are the same across these evaluations. The numerical scale of FID and sFID can vary with the evaluation sample size. Within each experiment, we hold the prompts, sample size, and evaluation protocol fixed across methods. These controls support meaningful comparisons of the methods or components within each experimental setting.
Response to Reviewer nMah [3/3]
4. Further analysis and correction of FID/sFID results (W5, Q4)
The FID and sFID entries for LF-CFG on SD3.5 were computed using a separate torchvision-based evaluator. We recomputed the metrics and reference statistics using the OpenAI guided-diffusion evaluator and the same reference preprocessing as CFG and SCG. The corrected FID is 18.156 instead of 19.930 and the corrected sFID is 46.953 instead of 12.614. The other five metrics remain unchanged. We rechecked the remaining evaluations and found no other FID/sFID protocol mismatches. We will correct these two entries in Table 1.
After the correction, TV-CFG and LF-CFG remain among the methods with lower FID and sFID on SD3.5. SCG achieves higher scores on all four preference metrics than both methods. These different rankings show that better distributional scores do not necessarily coincide with higher preference scores. We therefore assess generation quality through seven complementary metrics and human evaluation. We will expand the discussion to explain this metric pattern and the trade-offs exhibited by TV-CFG and LF-CFG.
5. Derivation and implementation details (W3, W6, W7, Q5)
Correction relaxation. Sampling proceeds from 1 to 0 over the interval [0, 1]. SCG applies spectral correction over (ρ, 1].
Timestep averaging. We do not assign additional weights to specific timesteps. Eq. 6 uses a uniform average over the inference timesteps of each backbone’s default scheduler.
Fourier cross-term. The Fourier transform is deterministic, so independent signal and noise remain independent in the Fourier domain. Linearity preserves the zero mean of the noise, so the cross-term vanishes in expectation at each frequency.
Numerical stability. We use ε = 10⁻¹².
We will clarify these points and specify the implementation details in the revised manuscript.
6. Baseline parameter settings and comparison protocol (W8)
The baseline settings follow the cited methods and comparison protocols described in Appendix E. For CFG++, we use λ = w/12.5 based on the approximate scale correspondence reported in the original work [1] and the same conversion used in ADG [2]. This conversion was not introduced for our comparison. ADG also reports negative ImageReward scores for CFG++ on SD3.5 under this conversion.
We also evaluated CFG++ on SD3.5 at λ = 0.28 (w = 3.5) and λ = 0.56 (w = 7), below and above the reported setting of λ = 0.36 (w = 4.5). These values follow the same λ = w/12.5 conversion. Reducing λ to 0.28 improves HPSv3 from −4.826 to −1.587 and ImageReward from −1.082 to −0.524. Increasing λ to 0.56 lowers ImageReward to −1.659. ImageReward remains negative across all three settings.
For TV-CFG, we follow the symmetric schedule used in the original main experiments [3]. The guidance scale peaks at the midpoint of sampling and its average is matched to the constant CFG scale in the corresponding experiment. These choices are documented in Appendix E and follow the published configuration.
Our comparisons evaluate the baselines under settings grounded in prior work. The improvements over standard CFG and the controlled interventions reported above provide additional evidence for SCG that does not depend on the parameter choices for CFG++ or TV-CFG.
Reference
[1] Chung et al. CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models. ICLR 2025.
[2] Jin et al. Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation. arXiv:2506.11039, 2025.
[3] Jin et al. Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Models. ICLR 2026.
Follow-up on our rebuttal
Thank you again for your review.
We extended the spectral distance analysis across backbones to assess its relationship with generation quality beyond a single model. We also added controlled ablations and trajectory analyses to examine the contribution of the proposed correction to generation quality and spectral consistency in individual samples. We clarified the evaluation protocols, baseline comparisons, and implementation details. These additions provide further empirical support for the practical value of the spectral criterion in assessing and correcting guided sampling trajectories.
We would appreciate your feedback on whether these additions address your main concerns.
Response to Reviewer nMah [1/3]
1. Theoretical basis and empirical validation of the spectral criterion (W1, Q1)
The spectral criterion is derived from a necessary condition for distributional consistency between the forward and reverse processes (lines 157–159), rather than from an empirical correlation. Proposition 1 derives a closed-form reference for the expected power spectrum of the forward marginal at each timestep. Distributional consistency requires agreement between the expected power spectra of the corresponding forward and reverse marginals. Eq. 6 quantifies this discrepancy at the distribution level by comparing the expected spectra of the corresponding marginals. Figure 2 examines how this discrepancy relates to generation quality. The preference-based evaluations and human study (Appendix H) provide complementary empirical evidence for the practical benefits of applying this criterion through our method, Spectral Correction Guidance (SCG).
1.A. Cross-backbone validation of the spectral criterion
We extend the analysis in Figure 2 to PixArt-α and SD3.5 to examine the relationship between spectral distance and generation quality across backbones. We follow the evaluation protocol of Figure 2 and evaluate CFG at w = 1, w = 4.5, and w = 13.5 using 1k prompts and the spectral-distance definition in Eq. 6.
For both backbones, the standard guidance scale of w = 4.5 achieves the lowest spectral distance, lowest FID, and highest IS among the evaluated scales. Increasing guidance to w = 13.5 increases spectral distance and worsens both generation metrics. These results support the practical value of the spectral criterion derived from distributional consistency and extend its empirical validation beyond SDXL.
1.B. Controlled intervention on the spectral correction direction
Next, we examine the causal contribution of reducing spectral distance to generation quality through a controlled intervention on the correction direction. We compare SCG with Anti-SCG using the same spectral reference at fixed CFG scales. Anti-SCG reverses the correction to move the spectrum away from the reference. This intervention extends the evidence beyond the correlations in Figure 2 by testing the effect of correction toward versus away from the reference. We conduct this comparison using 1k prompts on SDXL at w = 5 and SD3.5 at w = 4.5.
Compared with Anti-SCG, SCG achieves higher scores on all four preference metrics and lower FID for both backbones. The HPSv3 gains range from 0.371 to 1.836, the ImageReward gains from 0.037 to 0.190, and the FID reductions from 1.178 to 2.617. These preference gains also hold on SDXL, where Anti-SCG achieves a lower sFID. CLIP-T is lower by 0.0022 for both backbones. Reversing the correction at fixed CFG scales therefore worsens all four preference metrics and FID, providing intervention-based evidence for the contribution of correction toward the reference to generation quality. These results support the practical value of the spectral criterion.