- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies counterfactual generation from observational data using flow matching. Building on doubly robust training and learned source–target couplings, this work investigate how coupling quality affects finite-step sampling errors. Through two counterexamples, they show that small coupling displacement alone cannot guarantee small KL error for deterministic Euler sampling or sufficient score regularity without smoothing. To address these issues, they introduce Gaussian-smoothed interpolation and a score-corrected SDE sampler, establishing a coupling-sensitive KL bound controlled by the fifth displacement moment . They further derive finite-sample guarantees for learned velocity and score fields, leading to an end-to-end generation guarantee.
Critical strengths
-
The paper is well motivated, with a clearly formulated research problem and a convincing discussion of the limitations of existing approaches.
-
The proposed method is introduced naturally, with two counterexamples providing clear theoretical motivation for Gaussian smoothing and score-corrected stochastic sampling.
-
The theoretical analysis is comprehensive, providing coupling-sensitive sampling bounds and end-to-end guarantees that account for different sources of estimation error.
Critical weaknesses
W1. Limited experiments of in high-dimensional settings. may grow with dimensionality and its empirical estimation may be sensitive to large displacements. Although Figure 1(c) validates the relationship between and KL error in a two-dimensional setting, further analysis and experiments in high-dimensional learned settings are needed to understand how behaves and whether it remains predictive of the final generation error.
W2. Insufficient evaluation across different sampling budgets. The high-dimensional image experiments use a fixed number of 50 Euler steps. I think a systematic comparison across different sampling steps in high-dimensional settings would better demonstrate the proposed method.
W3. Minor presentation issues. Figure 1-3 contain relatively small axis labels, legends, and annotations, making them difficult to read.
Questions for authors
As mentioned in W1 and W2, my main concern is whether the proposed coupling-sensitive theoretical advantages translate into practical benefits in high-dimensional settings, particularly regarding the behavior of and generation error across different sampling step budgets. I would be willing to raise my score if the authors could address these concerns.
3 comments
We added experiments testing different sampling budgets (W2, Q1) and performed experiments on coupling displacement $D_5 $(W1, Q1). We also enlarged the axis labels, legends, and annotations in Figures (W3).
Given the impending discussion deadline tomorrow, could you please let us know whether these revisions address your concerns?
Thank you for your detailed responses. The additional experiments provide further empirical support for the coupling-sensitive analysis. I appreciate the authors' efforts and I am willing to raise my score.
Thank you for acknowledging our theoretical contribution and valuable suggestions.
sampling budgets (W2, Q1)
Experiments on D5 (W1, Q1)
For the image experiments, we added Table 1, where we observe that EOT coupling, which has a smaller estimated D5 than IID coupling, achieves lower SW2 under ODE sampling. Our proposed SDE sampler further improves performance and achieves the best result among the compared methods.
However, conducting an experiment similar to Figure 1(c) on images is challenging. Different coupling choices lead to different values of D5 but require separately trained velocity and score fields. Since their field-estimation errors may differ, it is difficult to isolate the effect of coupling displacement on sampling error. Moreover, accurately estimating D5 in high-dimensional image settings can be challenging.
To further investigate this relationship, we constructed a higher-dimensional synthetic example with d=32, where we can conduct an experiment similar to Figure 1(c). See our updated Figure 7 (right). We use exact velocity and score fields to eliminate field-estimation error. We observe that larger D5 is associated with substantially greater sampling error in the high-displacement regime, while our proposed SDE sampler achieves considerably lower error than the ODE sampler in this regime.
In summary, we would like to emphasize that both our image experiments and higher-dimensional synthetic experiment show consistent trends, supporting the practical relevance of our coupling-sensitive theoretical results.
Figure readibility (W3)
Contribution type
We emphasize that our main contributions are theoretical. Our counterexamples show that coupling displacement alone does not control the regularity needed to establish coupling-dependent sampling guarantees for deterministic sampling or without smoothing. We therefore study a Gaussian-smoothed stochastic sampler, where we prove that the required regularity can be controlled by coupling displacement, leading to a coupling-sensitive sampling KL error bound with nearly linear dimension dependence. In practice, Pooladian et al. [4] show that minibatch couplings improve ImageNet sample quality at low numbers of function evaluations (Section 6.2, Fig. 3 and Table 1). Tong et al. [5] similarly find that OT-CFM improves CIFAR-10 sample quality at small sampling budgets (Section 5.3, Fig. 3). These empirical findings, together with the motivation for learned couplings in Dance et al. [1], motivate our theoretical analysis of how coupling choice affects sampling accuracy.
Another key challenge is that the learned coupling depends on an imperfect prediction oracle, which introduces additional errors when training with the true target distribution. We address this by constructing an ideal coupling with the correct source and target distributions and controlling the error between these two couplings. Proposition 1 establishes finite-sample velocity and score estimation bounds involving this coupling-replacement error, the doubly robust nuisance-product term, and neural approximation and statistical estimation errors. Finally, combining these learning guarantees with our sampling analysis and smoothing error yields an end-to-end guarantee for the original counterfactual target.
[1] Hugh Dance, Johnny Xi, Peter Orbanz, and Benjamin Bloem-Reddy. Debiased Counterfactual Generation via Flow Matching from Observations. 2026. https://arxiv.org/abs/2605.07665
[4] Aram-Alexandre Pooladian, Heli Ben-Hamu, Carles Domingo-Enrich, Brandon Amos, Yaron Lipman, and Ricky T. Q. Chen. Multisample Flow Matching: Straightening Flows with Mini- batch Couplings. ICML, 2023. https://proceedings.mlr.press/v202/pooladian23a.html.
[5] Alexander Tong, Kilian Fatras, Nikolay Malkin, Guillaume Huguet, Yanlei Zhang, Jarrid Rector-Brooks, Guy Wolf, and Yoshua Bengio. Improving and Generalizing Flow-Based Gener- ative Models with Minibatch Optimal Transport. TMLR, 2024. https://arxiv.org/abs/2302.00482