Generative Modeling with Probability-Preserving Dynamics
Abstract
Modern generative modeling usually produces samples by transporting a simple noise prior to the data distribution. We study a complementary setting: once a useful state already exists, can a pretrained flow be reused as a stochastic transition rather than restarted from noise? We construct two reusable kernels directly from pretrained flow checkpoints, without retraining: a denoiser-based Metropolis kernel (dMALA), whose ideal target is the Gaussian-smoothed law , and a predictor–corrector kernel whose ideal target is . We also characterize how one-step model and numerical errors accumulate under a local contraction assumption. On ImageNet-256, dMALA repairs deliberately weak generated states from FID to while retaining high similarity to the input (DINO ). The same dynamics also support controlled variation: as the chain length increases, samples move progressively farther from their inputs, providing a controllable transition from local variation to broader exploration. Experiments on a synthetic Swiss-roll target, ImageNet-256, and Oxford Flowers-102 show that these dynamics can reuse existing flow models when a useful initial state is already available.
Then back it, or bet against it.
Related papers
Open the market on this paper to see 7 more related papers.