- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces global transport which pairs noise and data using optimal transport. The paper presents an interesting findings where class-agnostic GT couplings can give improved performances in conditional generation task, outperforming the widely used CFG technique. The theoretical results are clear and show that GT can reduce the gap between conditional and unconditional guidance, with empirical results supporting the claim. The experiment results in ImageNet look promising, as the mini-batch approximation is practically tractable, and it shows reasonable performance improvements. The ablation studies well support the claims made in the paper such as different coupling techniques (independent, GT, and class-conditional) and weight scheduler.
Critical strengths
S1. The paper is well structured. Clear motivation and formulations. It was easy to follow and grasp the main contributions of the paper. The problem the paper is trying to solve, and the proposed solution are also straightforward.
S2. Technical novelty. The proposed method is quite straightforward and simple to implement. It is quite surprising finding and can be quite useful in practice. The theoretical results, though assumes ideal conditions, are clear and intuitive enough to understand the behavior of the proposed method. To my knowledge, the fact that class-agnostic coupling can help guided sampling is clearly a novel finding which previously have not been explored.
S3. Practical impact. The proposed method is tractable with mini-batch approximation, which gives potentials to scale. Considering that CFG is a widely used practice in modern generative models, the work has great potential to the field. The experiment results are broad, covering different model sizes, sampling steps, and weights, and overall look convincing.
Critical weaknesses
W1. Limited scope of experiments. While broadly covering the claims made in the paper, the experiments are done in relatively small scale dataset ImageNet, and the model sizes are significantly small compared to modern generative models. While I stand more optimistic that the proposed method will scale to larger generative models, it is not shown in the paper. And this is the main concern I have in this paper. Can the authors show how it performs in state-of-the-art models such as FLUX 3 or Qwen-Image?
W2. Ideal assumptions. The theoretical results are intuitive, but they rely on strong assumptions of ideal velocity fields. While these can be difficult to show, this assumption hardly holds true in real world apploications, due to discretization step errors, model capacity, optimization. Instead, can the authors validate the proposed theoretical results in a simple 2D experiments? To show the tightness of the gap bound quantitatively.
Questions for authors
Q1. Can this method applied to transfer tasks (e.g., img-img) where the source distribution is also a discrete set of data points.
2 comments
We are grateful to the reviewer for their positive appraisal of our work and for helping us empirically strengthen our theoretical results by validating them in a real-world setting. As the rebuttal discussion is coming to a close, we would like to kindly ask whether our responses have adequately addressed your concerns. We would be happy to provide any additional clarifications or address any further questions during the remaining time of the rebuttal discussion.
Response to Reviewer Phpi
We are grateful to the reviewer for their thoughtful review and positive appraisal of our work. We appreciate their recognition that GT is “easy to implement”, that our theoretical results are clear and intuitive, and that the method offers practical scalability through mini-batch approximation. We are particularly encouraged by their assessment that GT “has great potential to the field”, given the widespread use of CFG in modern generative models. We also share the reviewer's enthusiasm for the surprising empirical results, which hold across multiple conditions, model scales, and sampling budgets. We hope these findings inspire further investigation into the training axis as a means of improving CFG. Below, we address the reviewer's questions and suggestions, grouped by topic.
Scope of Experiments
We are grateful that the reviewer is optimistic about GT scaling to larger generative models utilized in industry applications. We agree that this would be an extremely exciting experiment for GT and that showing results scaling to FLUX 3 / Qwen-Image would be highly impactful. Unfortunately due to compute constraints, we are unable to complete these experiments within the discussion period due to the scale of the models. We do believe this is a useful set of experiments and are in the process of sourcing compute to complete them. We believe our imagenet-scale experiments, while not as large as current state-of-the-art models, are still quite useful to the community.
Empirical validation of theoretical results
We agree with the reviewer that theoretical results assume idealistic conditions and that empirical investigations on a proposed gap in synthetically constructed experiment is a useful analysis.
As part of the rebuttal we acknowledge the importance of further validating this claim in real-world applications. We therefore measure the prediction gap in ImageNet-256 experiments across GT, class-conditional OT and independent transport plans using SiT-B/2 model with results in Table R3.
Table R3
We observe that GT has the lowest prediction gap across trajectory (250 Euler steps) correlating with our experimental results further validating our theoretical results. We thank the reviewer for raising this point and we include this analysis in section C.2.1 in the revised manuscript.
We highlight that the paper already provides similar analysis on the 40-Gaussian Mixture experiment (4 classes) in section 4. Figure 3 shows GT obtains the lowest prediction gap in a finite batch setting with velocity fields constructed as MLP networks empirically validates our theoretical results.
Transferability to image-image setting
The GT algorithm can be applied to transfer tasks such as img-img. However, we are somewhat skeptical that this is the right application for GT as the theory behind classifier-free guidance is only applicable in the Gaussian → data setting where we can perform approximate posterior inference by adding scores. In the data → data setting adding vectors no longer corresponds to adding scores nor approximate posterior inference. Therefore while GT can be applied in this setting procedurally we do not view it as a particularly promising direction at this time.
Conclusion
Thank you again for your time, encouraging feedback, and helpful suggestions. Please let us know if you have any further questions. We look forward to continuing the discussion.