- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This manuscript proposes a metric, martingale score, for optimizing, regularizing, or evaluating denoising diffusion models. The primary distinction from standard diffusion model setup is, it is assuming the trajectory data of the noisification process is given and used for parametrizing the neural models, contrast to the typical diffusion model setup that an analytical score or reverse-time drift is provided as regression target.
The theoretical setup of the method can be roughly summarized into the followings. The authors consider the reference process - the process of noisification - and a modeling process, characterized by their drifts and diffusions. If the drift of the modeling process is the same as the reference process, subtracting the model-predicted drift displacement from the reference displacement - here integrated to some finite horizon - results in a process that is a martingale with respect to reference process-induced filtration. Conversely, if the drift-offsetted process is a martingale with respect to the reference process-induced filtration, then the modeling process and the reference process have the same path laws. This is true under the following conditions (1) both processes are of the same Itô process form, with shared covariance matrix driving the Wiener noise, (2) both processes have the same initial law, (3) the relevant martingale problem is well-posed. With these asumptions, the martigale property becomes a metric that can be quantified, optimized, and evaluated through the defined martingale residual (MR), without knowing the score or reverse-time drift.
More technical nuances include the standard weak-form formulation for the stochastic process (on domain) and instrument functions. As most weak-form methods, the optimization in the end has to be carried out with a finite set of instrument functions, leading to Galerkin-type projection. The manuscript went through the technical nuances and provide a concrete numerical method to estimate the MR. The authors finally used the quantity to perform various tasks, including learning a diffusion model directly from MR, using MR to regularize or evaluate a diffusion model.
Critical strengths
- [S1] The reviewer likes the alternative construction of the MR metric stemming from weak-form and martingale theories. These analytic tools provide a principled approach that defines the MR score.
- [S2] Although an elementary fact, transferring the requirement of a complete set of test function to only the linear to a complete set of instrument function is very elegant.
- [S3] It is pleasing to see that under the assumption of a complete instrument function set and the infinitesimal-horizon ( limit), the MR score recovers the of the drift discrepancy between the reference process and the modeling process, establishing the connection to the conventional DDPM training objective.
Critical weaknesses
-
[W1.1] It is challenging for the reviewer to identify a scenario where the reference path is given and not the typical DDPM or score-based approaches. The typical workflow of diffusion models is to define the forward corruption process, which is usually simple zero-drift Wiener process (VE) or Ornstein-Uhlenbeck process (VP) and use Denoising Score Matching (Vincent, 2011) to use initial sample-dependent score, which is analytically tractable for the choices of these processes as the regression target to solve for the population-level score function. It appears to the reviewer that the manuscript still operates on these analytically tractable processes, raising the question that what advantages the MR score framework brings.
-
[W1.2] Although the theory seems to be consistent, the resulting method seems to be extremely similar to some form of flow, generator, or score-matching methods. In addition, the proposed method in this manuscript critically depends on the choice of the instrument function and the time discretization (). While the reviewer understood the setup of the problem is tied to only trajectories with finite-time () separation are given and most of these flow/generator/score-matching methods are using instantaneous samples, the manuscript can benefit from stating what the advantages of the proposed MR framework over the instantaneous matching framework.
- [Instantaneous samples] A special case is DDPM, which is in discrete-time nature, that the targets are derived from consecutive snapshots ; this case is particularly relevant as one can argue the DDPM's setup is also "trajectory-based", "with finite time seaparation", of an underlying Ornstein-Uhlenbeck process (arxiv:2311.17673).
-
[W2] In practice,
- a finite set of instruments instead of the theoretical complete set of basis function
- a fixed finite time grid and a scalarization of the strict martingale condition (The classical martingale condition imposes an infinite family of conditional constraints for every pair of times .)
It is unclear to the reviewer if this construct really reveal the path-law discrepancy, especially over existing path-law based methods (e.g., "Improved Sampling via Learned Diffusions", ICLR, 2024). Can the authors establish a quantitative relationship between their finite-horizon () and scalrized MR score and a standard path-space divergence, rather than merely identifying a common short-time limit? More concretely, does a small {\rm MR}= \Vert P_\cal{S} \mathbb{E}_\cal{Q} \left[ r_{t,h}^\theta \mid t, X_t \right] \Vert^2_{L^2 \left( \mu \right)} imples a small path-law divergence from Girsanov change of measure with the standard Kullback-Leibler divergence:
It is unclear to the reviewer if the MR score is more statistically efficient, robust, brings more computational advantages.
-
[W3] The paper’s framing as a diagnostic, regularizer, and standalone training method is stronger than the evidence supports. As a diagnostic, MR mainly tracks denoising MSE, without demonstrating clear added value over standard metrics. As a regularizer, it is compared only against denoising alone, so the reported FID gains are not shown to be specific to the MR construction. As a standalone objective, convincing from-scratch results are largely limited to low-dimensional synthetic problems; at image scale, the strongest result uses pretrained initialization, while from-scratch CIFAR training is unstable or substantially worse than denoising. The authors should either strengthen these claims with targeted diagnostic examples, meaningful regularizer baselines, and competitive image-scale from-scratch experiments, or reframe the paper as an exploratory study of MR objectives with strong population theory but mixed practical performance.
-
[W4] The reviewer is skeptical about numerically solving the - formulation given in Eq. (11). These saddle-point problems are notoriously challenging to optimize reliably, often exhibiting oscillation, instability, and hyper-sensitivity to optimization parameters. In addition, a learned finite set of instrument functions does not guarantee to recover the completeness of instrument functions.
-
Questions for authors
-
[Q1] The manuscript establishes a connection between martingale-residual minimization and the conventional squared drift-matching objective. The reviewer wonders about the distinction of the proposed framework, particularly given existing interpretations of diffusion training as velocity-field matching, including Wasserstein gradient-flow matching (Vuong et al., "Are We Really Learning the Score Function? Reinterpreting Diffusion Models Through Wasserstein Gradient Flow Matching", TMLR, 2026). Could the authors clarify what contribution of this manuscript is a new theoretical characterization, an alternative estimator/parametrization for learning, or an improved diagnostic, given the existing path-law based methods and flow/velocity-matching approaches?
-
[Q2] What is the intended practical information regime in which MR is preferable to existing trajectory-based SDE inference methods? In particular, can the authors give a realistic example where large numbers of reference trajectories and the covariance are available, but direct drift/score supervision is unavailable and standard drift-estimation, stochastic-force-inference, weak-form, or likelihood-based approaches are inadequate? A convincing answer would materially strengthen the significance of the method.
-
[Q3] The finite-set instrument results are closely related to standard Galerkin-type Extended Dynamic Mode Decomposition (EDMD, Williams et al., "Extended Dynamic Mode Decomposition with Application to the Navier-Stokes Equations", SIAM Journal on Applied Dynamical Systems, 2015) of stochastic generators. The matrix construction corresponds to the least squares projection of the martingale residual onto a finite-dimensional observable dictionary (standard notation in EDMD/DMD literature; here, "instrument"). Could the authors clarify the relationship to standard EDMD, Dynkin formula-based generator matching, and Petrov-Galerkin approaches and illustrate the necessity/advantages of the MR formulation?
-
[Q4] In Theorem 3.1, the admissible test-function class is defined relative to the reference law , but the conclusion is that solves the martingale problem for . What conditions ensure that this admissible class is a sufficiently rich domain/core for the learned generator so that the stated martingale identities determine ? If an additional core/domain assumption is needed, please state it explicitly.
-
[Q5] Can the authors compare MR regularization against at least one meaningful alternative auxiliary regularizer or matched-compute/matched-gradient control? The current denoising v. denoising+MR comparison does not establish that the observed FID gains are specific to martingale residuals.
-
[Q6] Can the authors provide a diagnostic example in which MR reveals a meaningful model defect or improvement that is not already apparent from denoising loss, FID, or another standard metric? The current diagnostic experiment mainly establishes that MR can track denoising MSE when the instrument family is sufficiently rich.
-