- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper formulates generation as minimizing divergence from a reference distribution subject to a lower bound on the spectral entropy of a kernel covariance. It identifies the data entropy as an Entropy Wall: below this wall, the KL projection moves the reference closer to the data distribution, whereas above it, the target is explicitly extrapolative. The penalized problem yields a self-consistent exponential tilt, which motivates a retraining-free guidance method whose potential is fitted on an independent pilot set and then frozen. Across experiments on synthetic data, ImageNet-100, CelebA-HQ, FFHQ, and SDXL, the method generally increases diversity.
Critical strengths
S1. Population-level target with independent sampling. The proposed frozen pilot construction enables independent sampling, unlike methods such as Particle Guidance and SPARKE that couple samples at inference time. The treatment of the regime beyond the Entropy Wall, together with the rigorous spectral tilt characterization covering existence, uniqueness, a converse result, and mutual absolute continuity, appears novel. The paper also states its theoretical limitations clearly.
S2. Consistent repair behavior. With moderate guidance, both objectives generally reduce FID/KID and DINOv2 distributional distances while increasing recall across all three benchmarks, albeit at some cost in precision. The strongest ImageNet RKE configuration achieves the best FID/KID in the main comparison.
Critical weaknesses
W1. Relevant overlap with prior work is not adequately discussed.**
- Exposing Diversity Bias in Deep Generative Models (Farnia et al., 2026, arXiv:2602.14682) is cited only in connection with the diversity gap. Its Section 6 defines the convex VNE superlevel set and proves the KL/Bregman projection inequality corresponding to the repair side of the present result. The current proposition is more general, and that work does not address the regime beyond the data entropy, but the main text should nevertheless credit and distinguish it.
- Flow Density Control (FDC; De Santi et al., NeurIPS 2025, arXiv:2511.22640) studies KL-regularized distribution-level utilities, including spectral functionals, in the same broader problem class. The paper should position its fixed-point characterization relative to FDC, and attribute the Gibbs variational principle underlying Theorem 1.
W2. The baseline comparison lacks a common trade-off, and the evidence for imagination remains indirect.
- IGA is swept over its guidance strength, whereas each baseline is shown at a single setting with no stated selection protocol. The ImageNet results expose a genuine trade-off: IGA is better on FID/KID and precision, while CADS has higher recall and entropy. At matched entropy on CelebA-HQ, IGA has lower FID and DINOv2 FD than SPARKE. Baseline sweeps on the same axes are needed for a fair comparison.
Questions for authors
- Which spectral stabilization method, pooling and clipping settings, sampler variant, sampling schedule, and CFG scale were used in each text-to-image experiment?
- Beyond the wall, different feature spaces can give conflicting indications of distance from the data. How should the guidance strength be selected without access to real data, and how were the text-to-image values chosen?
Minor:
- Please use consistent notation for unsmoothed von Neumann entropy (H₀ in Tab. 3 versus H in Tabs. 1–2).
- Information Projections Revisited (Csiszár and Matúš, IEEE Transactions on Information Theory, 2003), currently cited only in Appendix C.2, should also be cited with the corresponding main text.