- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper aims to improve upon a competitive drifting-model baseline [W-Flow] by resolving a balanced-OT constraint that is too stringent for data minibatches, where a small sample is not guaranteed to represent the real/generated distributions, and makes the training of W-Flow sensitive to minibatch composition. The authors address this by proposing UOT-GF, which modifies W-Flow using source-fixed unbalanced OT. The method fixes the source marginal while relaxing the target marginal, and makes the transport contributions from both directions symmetric, controlling reweighing using a KL penalty. Comprehensive empirical comparisons to related works including W-Flow across many metrics are conducted, demonstrating advantage over W-Flow in many cases/settings. The authors also derive the transport force and provide theoretical analyses of the gradient-flow dynamics.
Critical strengths
- The authors develop a well-motivated method that aims to address the minibatch imbalance sensitivity of W-Flow.
- A detailed comparison of the performance of various (U)OT methods, as well as settings within each method (Tables 1, 2). The authors demonstrate the importance of making the source-fixed transport contributions symmetric, rather than using only the forward direction or fully unbalanced OT.
- The paper includes thorough empirical evaluation of their method, across model sizes and different types of metrics, and compares against relevant baselines.
Critical weaknesses
Major Weaknesses
-
There is limited evidence for the proposed explanation of why UOT-GF solves the minibatch issue in W-Flow. The authors motivate UOT-GF as a way to reduce misleading transport directions caused by imbalanced minibatches. While toy examples/visualisations (see Fig 2, 4-7, 9) are helpful, it is unclear whether UOT actually produces more reliable transport directions during training. For example, the authors could use a frozen generator and compare transport directions estimated from many minibatches for W-Flow/UOT-GF, and use large batch estimates from each method as references.
- Minibatch sampling error is an issue that the authors motivate UOT-GF, and the authors provide this as a motivation for how UOT-GF may address problems caused by imbalanced minibatches.
- However, when the actual data distribution is imbalanced (eg 20% pens and 80% pencils in the "writing utensil" real images class), UOT-GF may still reweigh the transport mass assigned to real samples, potentially leading to more desirable transport directions, which could also explain improvements in performance metrics.
- The authors seem to focus on the imbalanced minibatch explanation as to why UOT-GF works well. Maybe there is another mechanism which the authors could discuss/demonstrate empirically.
-
Improvements across different evaluation metrics are mixed. Although UOT-GF improves FID, the improvements in FDr6 and Inception-Score are less consistent across model scales (Table 3). More discussion of these differences would help clarify different trade-offs, since these metrics measure different things. In particular, L/2 comparison with W-Flow shows a small FID improvement and worse FDr6.
- The authors should consider reporting FID across several evaluation seeds for the W-Flow-L and UOT-GF-L (row "KL tau = 0.985 - L" in Table 3) checkpoints. The FID difference between these two rows is 0.02 (1.36 - 1.34). The improvement is only 0.02 FID, so this would help assess how much the FID varies due to sampling variation.
Minor Weaknesses
-
Could UOT have difficulty with underrepresented modes? UOT can reduce the influence of oversampled or spurious targets, but it might also weaken the learning signal for legitimate modes that the generator has not learned (or has difficulty learning). Maybe authors can do a toy experiment involving underrepresented modes to clarify this trade-off.
-
The theoretical analysis studies idealised population dynamics (Eq 10), while actual training uses minibatch estimates and approximate transport computations (Eq 12-13). The authors do note this limitation in Appendix I; however, a toy experiment would help empirically establish the relevance of the theoretical analysis.
-
The authors use strong assumptions in the convergence analysis. The convergence guarantee (Proposition 5) relies on assumptions that may be difficult to satisfy when the generator does not adequately cover the data distribution (Assumption 4; Eq 27-28). While the authors acknowledge this limitation, further discussion of its implications for practical training would be helpful, particularly when modes are underrepresented. Ideally this would be supported by a toy experiment.
-
The text is quite dense, especially where math is involved.
Some of my concerns are related to limitations that the authors have themselves admitted to. Despite this, I think a more detailed treatment would improve the paper.
Questions for authors
See weaknesses.
[W-Flow] One-Step Generative Modeling via Wasserstein Gradient Flows, https://arxiv.org/pdf/2605.11755
3 comments
Checking In on Our Response and Revised Manuscript
Dear Reviewer Lnr1,
With the discussion phase wrapping up soon, we wanted to briefly check in and hope that our rebuttal and new results have satisfactorily addressed all of your questions. If you feel that the previous concerns are now resolved without any major remaining issues, we would deeply appreciate it if you might consider updating your evaluation accordingly.
We truly appreciate the time and effort you have dedicated to reviewing our paper, and we remain at your disposal should you have any further questions.
Warm regards, The Authors
Thank you for the rebuttal.
The new results in section H.10, H.11, and additional W-Flow baselines provide useful additional evidence. I expected two additional sets of seeds but the evaluation over 50 inference seed sets also addresses my concern at size L/2
I still think the explanation for why UOT-GF improves performance is not fully established, though there is indeed a performance improvement. Specifically better agreement with each method's own large-batch transport directions does not necessarily imply better generation performance. However, the new experiments provide a bit more support for the motivation that the authors claim.
Additionally, the text in both the authors' response and the paper is difficult for me to read. I hope the authors will go through the paper to brush up on the writing and make sure things are clear and not too terse.
Overall, I think the authors have addressed most of my concerns sufficiently, and I will maintain my marginal-accept recommendation since the paper is decent.
I expect the authors to release code and artefacts (eg checkpoints) upon acceptance in support of open source research, another reviewer also mentioned open-sourcing code.
Rebuttal
We thank the reviewer for suggesting a direct evaluation of mini-batch transport directions. We appreciate the time and effort invested in evaluating our work. The revised manuscript adds a frozen-generator experiment that compares how closely W-Flow and UOT-GF reproduce their own large-batch directions (Section H.10). We also added a controlled rare-mode recovery experiment to examine whether UOT-GF can help when the target distribution itself is imbalanced (Section H.11).
W1
W2
W3
W4
W5
W6