- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces a gradient-free sampling method for energy-based and certain score-based generative models using stochastic bounded extremum seeking (ES). The main idea is to replace the gradient-dependent drift in Langevin dynamics or a reverse-time SDE with high-frequency, coordinate-dependent cosine dithers whose phase depends only on a scalar energy or log-density evaluation. In the high-frequency averaging limit, the resulting stochastic dynamics recover the desired gradient drift. The paper proves convergence of the dithered Itô process to the target Langevin or reverse-time diffusion on finite time intervals, including quantitative rates under stronger regularity assumptions and extensions to several classes of nonsmooth energies. It also studies the finite-frequency and dimension dependence of the method. Empirically, the method is evaluated on synthetic sampling tasks, latent-space EBM sampling, and time-varying latent tracking on CIFAR-10 and CelebA-HQ. The paper explores an interesting connection between extremum-seeking control and generative-model sampling. However, I have concerns about the degree of methodological novelty, the narrow practical access model, and the limited evidence that the proposed approach provides a meaningful advantage over mainstream diffusion sampling methods.
Critical strengths
-
Using high-frequency ES dynamics to recover a Langevin or reverse-SDE drift from scalar function evaluations is conceptually interesting. The paper opens an alternative sampling route for settings in which automatic differentiation and direct score access are unavailable.
-
The extension of bounded-ES averaging to Itô processes appears to be a meaningful theoretical contribution. The paper establishes finite-horizon convergence, provides a mean-square rate under stronger assumptions, and considers increasingly nonsmooth energy functions. The analysis of frequency crowding and dimension-dependent evaluation complexity is also useful and appropriately exposes an important limitation of the method.
-
In the dynamic latent-tracking experiments, bounded ES performs better than several derivative-free baselines, including SPSA, coordinate finite differences, and Gaussian-smoothing estimators under a matched scalar-evaluation budget.
Critical weaknesses
- The algorithmic novelty is limited by its reliance on established ES machinery.
The core gradient-recovery mechanism—injecting high-frequency coordinate-wise dithers and obtaining an effective gradient through averaging—is inherited from bounded extremum seeking. The main novelty is applying this idea to Langevin and diffusion sampling and extending its averaging analysis to stochastic Itô dynamics. This theoretical extension may be valuable, but the generative-model methodology itself appears closer to a transfer of an established control technique than a fundamentally new sampling principle. The paper should more clearly separate what follows directly from prior bounded-ES results from what is technically new in the stochastic sampling setting.
- The practical access model is narrow.
The method requires repeated access to a scalar energy or log-density , while assuming that neither its gradient nor a score vector is available. This situation may occur for physical systems, nondifferentiable simulators, compiled models, or restricted APIs, but it is not the typical setting for modern diffusion models. Standard DDPM/EDM-type models directly output a score, noise, or velocity vector through a forward pass, while locally available energy models usually permit automatic differentiation. Moreover, ordinary score-only diffusion models do not directly provide the scalar required by ES; the proposed line-integral surrogate requires additional evaluations and can be biased for a nonconservative score. The paper therefore appears substantially less general for score-based models than its title and abstract may initially suggest.
- The experiments do not demonstrate an advantage over mainstream diffusion sampling.
The paper acknowledges that gradient-free pixel-space sampling is not competitive with well-tuned gradient-based samplers. In latent tracking, bounded ES improves over other zeroth-order methods but remains worse than the AutoDiff oracle. The CIFAR-10 and CelebA-HQ experiments mainly show that the method can operate in carefully constructed black-box tracking tasks; they do not demonstrate an advantage in standard unconditional generation quality, sampling efficiency, or wall-clock cost. Furthermore, the tracking experiments use near-deterministic, mode-seeking dynamics and are therefore closer to online black-box optimization than to distributional sampling. A real nondifferentiable simulator or physical measurement system would provide stronger evidence of practical value.
- There are ambiguities in the experimental specification and evaluation.
In the CIFAR-10 tracking experiment, Table 5 reports , whereas the accompanying text states that the tracker uses cost evaluations per frame. Since this directly changes the evaluation budget, the inconsistency must be resolved. The table also appears to be missing its bottom horizontal rule. More broadly, the paper should report the exact training objective for the diffusion energy model, clarify the parameterization and scaling of , and provide the values or selection procedures for , , , , and .
- Although the method uses only one scalar evaluation per step, this should not be interpreted as dimension-independent efficiency. Distinct coordinate frequencies become increasingly crowded as grows, and resolving the resulting beat frequencies requires a higher base frequency and a smaller integration step. The paper proves an at-least-linear evaluation cost but does not establish practical scalability beyond the latent-space experiments.
Questions for authors
What is the practically important use case that cannot be addressed by either direct score evaluation or automatic differentiation? Can the authors demonstrate the method on a genuinely nondifferentiable simulator, physical measurement system, compiled black-box pipeline, or realistic restricted API, including latency and wall-clock costs?
-
How much of the contribution is new beyond existing bounded ES? Could the authors explicitly identify which components of the algorithm and averaging argument follow from prior deterministic bounded-ES theory and which mathematical steps are fundamentally required by the stochastic Itô setting?
-
How should the method be fairly compared with mainstream diffusion samplers? In particular, can the authors report sampling quality and total computational or wall-clock cost against gradient-based latent samplers using the same underlying energy model? For score-only diffusion models, how many score evaluations are required to construct the line-integral surrogate, and how large is the resulting nonconservativeness bias?
-
Which evaluation budget was used for Table 5? Table 5 reports , while the text reports evaluations per frame. Please clarify the setting used to obtain the reported results and provide the missing implementation and energy-training details needed for reproduction.