- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates the relationship between denoiser Jacobian spectra and generative performance. The authors observe that better-performing models tend to exhibit larger principal Jacobian eigenvalues and propose residual-based and stochastic regularization to control spectral properties and improve generation quality.
Critical strengths
-
Meaningful research question and coherent methodology. The paper presents a clear research progression from empirical observations and theoretical analysis to targeted regularization methods and experimental validation.
-
Interesting theoretical insights. The connection between Jacobian spectra and posterior covariance provides a principled motivation. Using denoising residuals to strengthen principal spectral directions without explicit eigendecomposition is particularly interesting.
-
Encouraging experimental results. The proposed regularization improves FID across SiT-S, SiT-B, and UNet. Combining residual and stochastic regularization further improves performance, suggesting complementary benefits.
Critical weaknesses
-
Insufficient validation of stochastic regularization's spectral mechanism. The authors argue that moderate stochastic regularization suppresses weak, data-irrelevant spectral directions while preserving principal components. However, Figure 5 mainly shows that the top-10 eigenvalues remain nearly unchanged. This does not establish that weaker components are suppressed or that they are data-irrelevant. Consequently, the proposed explanation for the complementarity between the two regularizers remains insufficiently verified.
-
Inconsistent improvements across sampling settings and metrics. Stronger spectral amplification does not always improve FID, and the benefits of residual regularization diminish under some CFG settings. FID and sFID also occasionally show conflicting trends, suggesting that the relationship between spectral properties and generation quality is more nuanced.
Questions for authors
Q1. Can the authors directly demonstrate that stochastic regularization suppresses weaker spectral components, for example by comparing broader spectra across all four model variants?
Q2. What evidence indicates that the suppressed directions are data-irrelevant rather than weak but meaningful variations?
Q3. Can the authors clarify the reduced benefits under CFG and the occasional discrepancies between FID and sFID?