- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates mode collapse detection in neural samplers without access to ground-truth samples. The authors analyze the limitations of conventional diagnostics, including ESS and normalizing-constant comparisons, and propose an auditing method combining multi-start mode search, Laplace mass estimation, and empirical basin-occupancy comparisons. Theoretical results characterize the limitations of these diagnostics and the proposed estimator. Experiments on synthetic multimodal targets and a controlled-SDE sampler demonstrate promising accuracy and computational efficiency, while also highlighting the method's limitations on more challenging energy landscapes.
Critical strengths
- The paper addresses an interesting and important problem: detecting mode collapse in neural samplers without access to ground-truth samples, where conventional diagnostics may provide misleading assessments. Developing reliable and computationally efficient diagnostics in this setting is practically valuable and deserves further investigation.
Critical weaknesses
- The proposed method relies heavily on established techniques, as acknowledged by the authors in Section 3. Similar procedures have also been explored in existing Laplace-mixture approximation methods, such as [1] (Sec. 3.5). The main additional step is to compare the estimated target basin weights with empirical occupancy frequencies from the trained sampler, resulting in a standard total variation distance between two discrete distributions. While this provides a potentially useful application to sampler auditing, the construction appears relatively straightforward and does not exploit any specific properties of neural samplers. Consequently, the paper does not sufficiently establish a substantial methodological advance beyond adapting existing mode-based approximation techniques to a new evaluation task.
- Although the paper presents eight propositions, most of the theoretical results characterize the limitations of existing diagnostics or the failure modes of the proposed approach, rather than establishing new positive guarantees for the estimator itself. In particular, Propositions 1–4 largely follow from standard importance-sampling identities, while Propositions 5–7 demonstrate the impossibility of finite-query certification and the potential failures of incomplete mode enumeration. Proposition 8 provides a conditional bound on local-mass approximation errors, but does not establish an overall estimation guarantee accounting for mode discovery and sample assignment. More importantly, despite the central claim that mode collapse is cheap to detect, the paper provides no theoretical characterization of the computational complexity required to achieve a prescribed estimation accuracy. Consequently, the theoretical analysis is informative but offers limited support for the claimed accuracy and computational advantages of the proposed auditing method.
[1] Huang Y. Sampling via Gaussian Mixture Approximations[J]. arXiv preprint arXiv:2509.25232, 2025.
Questions for authors
- Most theoretical results characterize diagnostic limitations rather than establish positive guarantees for the proposed estimator. Under what assumptions can the authors guarantee its estimation accuracy, particularly when mode enumeration is incomplete?
- Given that discovering important modes and computing their Hessians can be expensive, what justifies the central claim that mode collapse is cheap to detect beyond the specific benchmarks considered? How does this advantage depend on the complexity of the target energy landscape?