- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper study whether the diffusion 'coarse-to-fine' recovery really tells us what drives denoising. It tracks when different frequency bands in a model’s prediction line up with a known clean image. The main observation is that a spectrum-based clock becomes indistinguishable from a simple band-index clock under natural power-law spectra and log-spaced bands. To separate these explanations, the authors edit image spectra in SD3 and independently vary training and evaluation noise covariances in TinyDiT. They also check shuffled targets, random decoders, and PixelDiT. A fitted attenuation model predicts recovery shifts under unseen evaluation covariances, although its advantage depends on the measurement setup and intervention direction.
Critical strengths
The controlled covariance-intervention study is a major strength of this paper. The authors hold clean images and total expected noise power fixed, independently vary training and evaluation covariance, and fit attenuation on source endpoints before testing unseen evaluation conditions. This tests an explicit predictive hypothesis beyond descriptive coarse-to-fine correlations. It shows that the proposed protocol can produce useful, testable predictions about recovery behavior.
Critical weaknesses
-
Contributions and novelty are both limited. No significant theoretical insights or empirical results are provided. Existing research already connects frequency-dependent recovery to image spectra and noise structure, and studies anisotropic corruption [1, 2, 3]. The affine-equivalence observation follows directly from power-law spectra and log-spaced bands. The paper adds a careful measurement protocol, but offers limited new understanding of diffusion.
-
The results seem quite setup-dependent. The Fourier-clock advantage largely disappears with image-first averaging and reverses with different frequency bins. The training-dependent gain also loses to a shared gain on the orthogonal test.
[1] A Fourier Space Perspective on Diffusion Models [2] Show the Signal, Hide the Noise: Spectral Forcing for Pixel-Space Diffusion [3] Learning What Matters: Steering Diffusion via Spectrally Anisotropic Forward Noise
Questions for authors
Can the conclusions of this paper be used to build and train a better diffusion model?