acceptodds
Under review as a conference paper at ICLR 2027

Mode Collapse Is Cheap to Detect: A Ground-Truth-Free Pre-Flight Check for Neural Samplers

Abstract

Neural samplers are trained against an unnormalised target with no samples from , so a practitioner cannot tell whether an expensive run has silently dropped part of the target. The usual diagnostics are expectations under the model and are therefore confined to its support: we exhibit a sampler with self-normalised that misses of the mass. Splitting the missing mass into lost support and misallocated weight shows the two established diagnostic families have disjoint blind spots – ESS is blind to the first, and normaliser comparison is provably blind to the second at any budget, returning while up to of the mass is misallocated. We then argue that detecting missing mass is easier than sampling it – detection needs one point per missed basin plus local curvature, while correcting the sampler generally costs substantially more – and turn this into a pre-flight check using only . On exactly solvable targets the check reaches -level accuracy at a few percent of training cost on the harder benchmarks, while a tuned SMC reference requires – of training cost, and it applies unchanged to a controlled-SDE sampler with no tractable density. A self-diagnostic flags configurations whose estimate should not be believed, but cannot certify a run: a mode with attraction probability below escapes the estimator and the diagnostic together. We map the resulting boundary on LJ-13.

open until 14 Dec 2026

est. 32% chance this paper gets accepted at ICLR 2027.

Reject 68%Accept 32%

What do you think this paper will get?

All positions stay anonymous.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.