- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces a Predictive Sufficiency Gap (PSG) to reframe U-Net downsampling in diffusion models as a target-specific predictive information interface. It derives exact sufficiency conditions under Gaussian linear assumptions, proves that optimal retained subspaces generically vary with diffusion SNR, and validates these findings using a tractable Haar model and controlled CIFAR-10 experiments.
Critical strengths
The paper studies a clear and important research question, namely what and how to separate the important details during compression with UNets. The paper also included FID evaluations.
Critical weaknesses
From my point of view, the analysis is very limited and the results have little significance for current diffusion models due to studying only a single 32-16 downsampling step on CIFAR10. Furthermore, the gains are below 1% and do not preserve when measuring FID.
Questions for authors
Can the authors explain their exerimental setup choice and examine practical impact considerations?
Response to Reviewer eXkK
Theoretical contribution and setup choice. We study what a target-specific multiscale interface must preserve, rather than proposing a new diffusion sampler. For Gaussian linear observations, Sec. 3.2 gives an exact predictive-sufficiency criterion. Under rank matching, the sufficient measurement subspace changes between distinct diffusion SNRs precisely when the target subspace is not invariant under the data covariance; in that case, time-conditioned measurements attain zero aggregate PSG while every static rank-matched subspace has a strictly positive minimum. Section 4 separately gives an explicit 8×8 periodic Gaussian Haar construction: a local, SNR-dependent three-tap preprojection realizes sufficiency at fixed retained dimension and yields a strict conditioned/static and pre/post separation under its stated assumptions. These results are specific to their stated assumptions.
The CIFAR-10 32→16 transition was selected as a controlled test of this interface question. It fixes an RGB noisy observation, a coarse ε target, normalized Haar projection, and matched PRE/COARSE parameterizations, while a Null-Time control isolates correct timestep conditioning. It also supports learned-subspace and Gaussian-linear surrogate diagnostics (Sec. 5.1; Figures 3–4). The revision also clarifies the complete-skip Bayes boundary (Sec. 3.3) and adds finite feature/Post-D readouts and a skip-access interaction study (Secs. 5.3–5.4).
Practical impact. Although the matched end-to-end MSE gain is only 0.0260% and PRE has worse FID than matched COARSE (16.1744 vs. 15.4174; Sec. 5.2), the contribution is a diagnostic framework for target-relevant information and its finite use in skip-connected computation, not demonstrated gains in generation quality or efficiency, or transfer beyond the tested setting.