- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proves that for any nontrivial finite Gaussian mixture model with positive component weights and positive-definite covariance matrices, the excess mean-squared error has a strictly positive lower bound over all real constant multipliers. This lower bound also extends to deterministic denoising diffusion implicit models under the stated conditions.
To approximate the posterior mean, the paper proposes Simple Endpoint Correction, which combines two constant-scaling endpoints. Experiments show that GMMs fit image latents better than single Gaussian models. Endpoint correction also reduces posterior-mean error on synthetic GMMs and image-space MSE for DiffC-SD2.1, ResULIC, and ELIC + DDIM/DSG.
Critical strengths
The paper provides substantial theoretical analysis, and its central result is valuable. It proves that, for any nontrivial finite GMM, no fixed score multiplier can exactly recover the posterior mean, and it extends this result to DDIM.
Critical weaknesses
- The connection between the theory and the experiments is relatively weak. The paper mainly studies posterior-mean approximation and MSE minimization, but it does not establish that better posterior-mean approximation necessarily improves distortion at a fixed perception level. Section 5.3 uses the Wasserstein distance only for one-dimensional synthetic GMMs, whereas Section 5.4 uses LPIPS and does not compare the methods at matched LPIPS levels.
- The experimental results raise some questions. In Table 5, for ResULIC, the MSE and LPIPS values for the Native, Constant, and Effective constant methods are identical across all datasets.
Questions for authors
- Section 5.3 shows that fixed score scaling incurs excess distortion in the PD tradeoff at the level of theoretical distributions. Does SEC address this issue?
- Why are the values for Native, Constant, and Effective constant exactly identical for the ResULIC model?
- The paper claims to compare SEC with a dense grid of constant multipliers. What multiplier values were selected for the Constant method in Table 5?
- Why do some images in Figure 3 have borders while others do not?