- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes UW-Flow, a teacher-free one-step generative method that extends W-Flow by introducing unbalanced optimal transport. The method aims to reduce the undesirable transport caused by marginal fluctuations in finite minibatches. The authors replace the balanced Sinkhorn divergence with a debiased unbalanced Sinkhorn divergence and derive the corresponding Wasserstein velocity field. They provide theoretical analyses of target identifiability and finite-batch velocity estimation errors. The analysis shows that unbalanced transport can reduce velocity estimation errors under certain conditions, particularly for well-separated modes. Experiments on synthetic distributions, MNIST, CIFAR-10, and ImageNet-100 demonstrate improvements in generation quality over W-Flow.
Critical strengths
-
Clear motivation and well-designed method. The paper identifies an important limitation of balanced optimal transport under finite-batch marginal fluctuations. The proposed unbalanced formulation directly addresses this issue while retaining the main structure of W-Flow. The method is simple and has a clear connection to the identified problem.
-
Meaningful theoretical analysis. The paper provides a theoretical characterization of finite-batch velocity estimation errors for balanced and unbalanced transport. The separated-mode analysis offers useful insights into why marginal relaxation can improve stability. These results strengthen the motivation for the proposed method.
-
Solid experimental validation. The experiments cover synthetic distributions and multiple image generation benchmarks. UW-Flow consistently improves FID over W-Flow under matched training budgets, with particularly notable gains in unconditional generation. The batch-size ablations also provide empirical support for the theoretical analysis.
Critical weaknesses
-
The paper shows that unbalanced optimal transport can reduce finite-batch velocity estimation errors under certain conditions. However, the balanced and unbalanced methods are compared against their own population velocity fields, which are generally different. Therefore, a smaller estimation error does not necessarily imply better generation dynamics or convergence to the target distribution. The paper lacks direct evidence connecting the improved velocity stability to the observed gains in generation quality. Additional experiments measuring velocity errors and generation performance during training would strengthen this connection.
-
The theoretical stability advantage of UW-Flow is established mainly under fixed-support assumptions and a specific separated-mode setting. However, real-world data distributions can have more complex structures, including overlapping modes and varying degrees of imbalance. It remains unclear whether the theoretical advantages extend to these settings. Moreover, the experimental results depend on the relaxation parameter, which is selected based on generation performance. A more systematic evaluation across different distribution structures, transport batch sizes, and relaxation strengths would help establish when UW-Flow provides reliable improvements over balanced transport.
Questions for authors
Comparison with recent UOT-based one-step generation methods. The recent paper One-Step Generative Modeling via Unbalanced Optimal Transport (arXiv:2609.32708) studies a closely related problem and proposes UOT-GF, which relaxes only the target-data marginal while keeping the generated-sample marginal fixed. Could the authors clarify the methodological and theoretical differences between UW-Flow and UOT-GF? In particular, what are the advantages of relaxing both marginals rather than only the target marginal? A direct comparison under matched settings would help establish the distinctive contributions and practical benefits of UW-Flow.