- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Generalized Moment-Informed Flow Matching (GMI-FM) to incorporate intermediate moment constraints into trajectory inference. It learns a constrained conditional interpolant and then trains a velocity field through simulation-free flow matching. The authors establish connections to moment-constrained Schrödinger bridges and demonstrate improved marginal reconstruction on synthetic and real-world datasets.
Critical strengths
- Incorporates intermediate moment constraints into flow matching through a simulation-free framework.
- Provides theoretical connections to moment-constrained Schrödinger bridges.
Critical weaknesses
- The fixed OT coupling does not incorporate moment constraints, creating a gap between the theoretical assumptions and the implemented algorithm.
- The experimental evaluation raises concerns about checkpoint selection using intermediate snapshots and lacks experiments with multiple constrained time points.
Questions for authors
1. Inconsistency between the coupling and theoretical formulation.
The method uses standard OT or entropic OT coupling without incorporating intermediate moment constraints. However, Proposition 2 assumes the optimal moment-constrained Schrödinger bridge coupling, which generally differs from the coupling used in practice. The authors should provide a theoretical justification for this discrepancy, clarify how the coupling mismatch affects the validity of Proposition 2, and conduct numerical experiments comparing standard OT with moment-informed couplings in terms of constraint satisfaction and reconstruction accuracy.
2. Potential overlap between validation and test data.
In the Multi experiments, the complete marginal distribution at the unconstrained time point is used for checkpoint selection, while reconstruction is also evaluated at that time point. The authors should clarify whether validation and test samples are independent and report results without using the unconstrained intermediate distribution for model selection.
3. Lack of experiments with multiple constrained time points.
Although the framework supports moment constraints at multiple intermediate time points, the experiments only consider one constrained time point at a time. Additional experiments with multiple constrained time points are needed to evaluate the method's generality and scalability.
5 comments
Influence of the coupling (2/3)
The following paragraphs provide further details on the results.
(a) Couplings with finite relative entropy
We consider a fixed coupling satisfying:
under the same regularity and duality assumptions, with the required integrability imposed under .
Using the single-observation setting of Proposition 2 and , define the feasible parameter set:
\Theta_\pi = \left\\{ \theta: R_{\mathrm{lin}}(\theta) \lt \infty,\quad \mathbb{E}_{Z\sim\pi} \bigl[f(I_\theta(\tau,Z))\bigr]=a \right\\}.
Assume this set is nonempty, and let be an ideal minimizer of problem (6) under coupling . Define
the best relative-entropy approximation of achievable within the feasible interpolant family using that coupling. Then
where and are as in Proposition 2.
Indeed, the entropy chain rule gives
The endpoint-coupling term is independent of . Repeating the conditional entropy and noise-bias arguments from the original proof, with expectations and feasibility evaluated under , therefore yields the stated bound. Thus, the excess relative entropy of the ideal solution of (6), compared with the best approximation available within the same feasible interpolant family and coupling, satisfies the same bound as in Proposition 2. The approximation error itself depends on the coupling and includes its mismatch with .
(b) OT coupling
For unregularized quadratic OT between population distributions, the preceding finite-KL extension generally does not apply. Indeed, finite relative entropy requires absolute continuity:
When is absolutely continuous, the quadratic-OT coupling is induced by a deterministic transport map :
\pi_{\mathrm{OT}}=(\operatorname{Id},T)_\\#p_0.
Consequently, all its mass lies on the graph . By contrast, the endpoint coupling of a finite-entropy SB with a nondegenerate Brownian reference is absolutely continuous with respect to , and therefore assigns zero mass to this graph. Hence,
This population-level obstruction should be distinguished from discrete approximations. For OT and SB coupling matrices on the same finite endpoint supports, the KL is finite whenever the SB coupling is positive on the support of the OT coupling. For the population OT case, we instead consider a comparison between time marginals, under additional stability assumptions on the conditional bridges.
In the population OT setting, we seek a bound on since the path-space is infinite. Let denote the SB marginal at time , conditional on the endpoint pair . We assume that finite constants , uniform over the relevant endpoint pairs, satisfy
The first assumption converts conditional relative-entropy error into Wasserstein error. The second requires that small changes in the endpoints produce controlled changes in the conditional intermediate distribution. The first condition holds automatically for several common observation families in our Brownian-reference setting. For affine or normalizable quadratic tilts, the conditional SB marginals remain Gaussian and therefore satisfy a transport–entropy inequality. Globally bounded observation functions, with finite dual multipliers, produce bounded perturbations of Gaussian laws, which also satisfy this inequality. In these cases, the constants can be chosen uniformly over endpoint pairs. Thus, for these observation families, the transport–entropy condition follows from the stated model assumptions. For general unbounded nonlinear observations, additional control of concentration is required; normalizability alone is insufficient.
Influence of the coupling (3/3)
Retaining the remaining feasibility and regularity assumptions of Proposition 2, let denote the marginal of the ideal Stage-A interpolant obtained under . Then
Here, is the smallest average conditional path-space KL achievable by a feasible interpolant under the OT coupling. The bound separates three contributions: removal of the auxiliary Brownian-bridge noise, endpoint-coupling mismatch, and conditional approximation and selection errors. It therefore provides a comparison with the constrained SB even when the endpoint couplings are singular relative to one another, while making explicit that a small right-hand side guarantees closeness to the constrained SB marginals.
(B) Empirical Results
Our use of endpoint-only OT couplings was motivated by computational simplicity and empirical observations in related work. For example, Tong et al. [1] (SF²M, Appendices A.1 and D.2) explain that, although entropic OT provides the coupling required for their SB formulation, unregularized OT can perform better in some settings. While this observation concerns a different setting, it motivated our choice of OT, particularly given the additional computational cost of constructing a moment-informed coupling.
To assess the difference in performance, we ran GMI-FM (lin) and GMI-FM (LAND) with a numerically computed moment-constrained SB coupling on all four benchmarks. Values are average reconstruction (lower is better), reported as mean ± population standard deviation over five seeds.
| Dataset | Method | SB coupling: | Endpoint-only: | SB coupling: residual | Endpoint-only: residual |
|---|---|---|---|---|---|
| Synthetic | GMI-FM (lin) | 0.1723 ± 0.0064 | 0.1710 ± 0.0063 | 0.0339 ± 0.0147 | 0.0248 ± 0.0149 |
| Synthetic | GMI-FM (LAND) | 0.1867 ± 0.0089 | 0.1834 ± 0.0076 | 0.0414 ± 0.0096 | 0.0359 ± 0.0126 |
| Aerosol | GMI-FM (lin) | 0.3091 ± 0.0015 | 0.2917 ± 0.0001 | 0.0335 ± 0.0212 | 0.0013 ± 0.0005 |
| Aerosol | GMI-FM (LAND) | 0.2980 ± 0.0018 | 0.2873 ± 0.0002 | 0.0072 ± 0.0031 | 0.0011 ± 0.0008 |
| Multi | GMI-FM (lin) | 10.4688 ± 0.0042 | 10.5401 ± 0.0020 | 0.0340 ± 0.0010 | 0.0419 ± 0.0028 |
| Multi | GMI-FM (LAND) | 9.9478 ± 0.0032 | 10.0937 ± 0.0035 | 0.0762 ± 0.0012 | 0.0822 ± 0.0008 |
| Semrau | GMI-FM (lin) | 1.9724 ± 0.0023 | 1.9961 ± 0.0010 | 0.8356 ± 0.6413 | 0.7197 ± 0.6165 |
| Semrau | GMI-FM (LAND) | 1.7197 ± 0.0020 | 1.6726 ± 0.0062 | 0.3136 ± 0.1070 | 0.6887 ± 0.3340 |
The results suggest that the benefit of moment-informed endpoint pairing depends on both the dataset and the geometric prior. Endpoint-only configurations achieve lower mean reconstruction errors on Synthetic and Aerosol, although the differences on Synthetic are modest relative to variability across seeds. The SB coupling improves reconstruction on Multi for both variants. On Semrau, it improves GMI-FM (lin) but worsens GMI-FM (LAND). Thus, incorporating moment information into the coupling does not yield a uniform reconstruction advantage. These findings complement the theoretical discussion: optimality for the moment-constrained SB objective does not guarantee lower reconstruction error, and these experiments assess the practical effect of changing the coupling.
Computing the moment-informed coupling also introduces additional cost. On Multi, coupling preparation took approximately 6–9 minutes, including refinement and sampling checks, compared with 5–7 seconds for entropy-matched endpoint-only coupling. This overhead arises from evaluating moment-dependent conditional expectations across four million endpoint pairs and repeatedly rebalancing the coupling during optimization.
Update: We have added a discussion of the change in the **proposition 2 when considering different coupling in appendix H.5. The empirical results are included in the appendix C.9.
[1] Alexander Y. Tong, Nikolay Malkin, Kilian Fatras, Lazar Atanackovic, Yanlei Zhang, Guillaume Huguet, Guy Wolf, and Yoshua Bengio. “Simulation-Free Schrödinger Bridges via Score and Flow Matching.” AISTATS 2024, Proceedings of Machine Learning Research, 238:1279–1287.
Influence of the coupling (1/3)
Thank you for your thoughtful comments and suggestions, which have helped us significantly improve our manuscript. Please see the revised PDF, where the changes are written in blue. We also directly respond to your points below.
I. Influence of the choice of coupling
We respond to your comment on the choice of coupling and its theoretical and empirical implications.
(A) Theoretical Results
Proposition 2 uses the endpoint coupling π⋆=P0,1⋆ of the moment-constrained Schrödinger bridge to isolate the difference between conditional path constructions. However, we can relax this assumption and account for coupling mismatch.
For couplings with finite relative entropy to π⋆, the same bound holds on the excess KL above the best feasible approximation under the chosen coupling. For singular population OT couplings, a finite path-space KL comparison is unavailable, but additional regularity of the conditional bridges yields a W2 bound between time marginals. We summarize these two extensions below. Further details are provided below the two statements. Additionally,The full statements, assumptions, and proofs are included in Appendix H.5 of the revised manuscript.
Throughout, θπ⋆ denotes an ideal minimizer of (6) with Rprior=Rlin, and rH=∣λ⋆∣Hdσ2τ(1−τ) is the remainder in Proposition 2.
0≤KL(Qθπ⋆σ,π∥P⋆)−εapp(π)≤rH.
This includes entropic OT couplings when the stated conditions hold. Here, εapp(π) is the best KL approximation achievable within the feasible interpolant family using π. The upper bound on selection excess remains unchanged; the approximation error itself can change because it also incorporates coupling mismatch.
W2(ptOT,Pt⋆)≤σdt(1−t)+LtW2(πOT,π⋆)+2Ct(εcond(πOT)+rH).
Here, εcond is the best average conditional path-space KL within the feasible family. This result controls the distance between time marginals, separating auxiliary noise, endpoint-coupling mismatch, and conditional approximation and selection errors. It remains meaningful when the endpoint-coupling KL is infinite.