- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to study how can we reduce conditional velocity and acceleration variability in Hierarchical Rectified Flow (HRF2). It proposes two levels of optimal transport coupling: (1) minibatch OT between the source and the target data; (2) conditional OT between the initail and target velocities of the inner flow model. This paper further analyzes the effects of these couplings on conditional variance and evaluate generation quality on extensive experiments, showing promising results.
Critical strengths
S1: Conditional velocity coupling is a clear methodological contribution for HRF2
Compared to previous methods that models conditional velocity distributions with an inner flow, this paper models OT coupling in data space and couples the endpoints of the inner velocity flow, which allows for directly acting on the acceleration matching objective. The methodoloical is grounded in several theoretical foundations. In summary, it provides a concrete framework for studying coupling at multiple levels of a hierarchical generative model.
S2: the experimental results are promising
The medthod shows great achievements in few-step and high-resolution image generation.
Critical weaknesses
W1: The contribution of velocity OT to the main empirical gains is unclear
It is observed that on CIFAR-10 at 5 NFE, second-stage training with teacher-generated velocity pairs achieves 6.632 FID without velocity OT. It shows 6.315 with OT (Table 13) and 22.817 for HRF2-D. Most of the reported improvement over HRF2-D seems to occurs before velocity OT is added. I believe some similar controlled ablation is needed for the headline CelebA-HQ and ImageNet results.
W2: Theorem 3.2 is stronger than its proof supports
This theorem claims marginal preservation for the continuous-time process in Eq. (6), but Appendix D seems to prove it for discrete updates that sample a conditional velocity at each step. Hence It does not establish the claim for a continuous coupled ODE with a fixed inner random seed. It is suggest that the authors should specify the intended process and revise the theorem or its proof accordingly.
Questions for authors
Q1: Please refer to Eq. (6), is the inner random seed reused throughout the continuous outer trajectory, or is a new seed drawn at each outer step? The distinction appears relevant to the claim in Theorem 3.2.
Q2: Does the HRF2-D&V training loss of 0.010 in Table 9 estimate conditional dispersion for the teacher-generated velocity distribution or for the conditional velocity distribution induced by the data coupling? How should this distinction affect the interpretation of the result?
Q3: Equations (8) and (22) express the data and velocity couplings as joint densities. How are these formulas interpreted for exact OT couplings, which may be supported on a transport map and have no joint density?
4 comments
QC4: Does the HRF2-D&V training loss of 0.010 in Table 9 estimate conditional dispersion for the teacher-generated velocity distribution or for the one induced by the data coupling? How should this affect the interpretation?
It estimates for the velocity distribution generated by HRF2-D, since HRF2-D&V is trained on pairs with . The HRF2 and HRF2-D losses use , i.e., the distribution induced by the data coupling. This matters in two ways.
(1) Thm. 3.6 holds for any target velocity distribution with a finite second moment, so the drop to 0.010 still tests it: under OT coupling, the acceleration toward is nearly deterministic, and a single inner step suffices.
(2) The loss does not measure how well matches . That gap is a separate error, bounded through and in Cor. E.13, and it is consistent with the higher FID of HRF2-D&V at large NFE (Remark E.14).
We now state this distinction in Sec. 3.5 and Appendix G.2, and no longer present Table 9 as a pure coupling comparison.
QC5: Eqs. (8) and (22) express the couplings as joint densities. How are these formulas interpreted for exact OT couplings, which may be supported on a transport map and have no joint density?
As in [1, 2], denotes a joint distribution with marginals and , is the conditional distribution of given , and Eq. (8) is its density form. For the exact OT coupling, Eq. (8) holds in the distributional sense: substituting and applying the change-of-variables rule for the delta gives , in agreement with Thm. 3.3. The same calculation applied to Eq. (22) gives the Dirac mass of Thm. 3.6.
We added a remark after Thm. 3.1 stating this interpretation and a remark after Cor. B.2 with the full derivation. The derivation is formal, since the OT map can be discontinuous for multimodal targets. All results involving exact OT (Thm. 3.3, Thm. 3.6, Lemma E.8, Cor. E.9) are therefore proved with conditional laws only, and the new proof of Thm. 3.2 does not use densities either.
References:
[1] Pooladian et al. Multisample flow matching: Straightening flows with minibatch couplings. ICML, 2023.
[2] Tong et al. Improving and generalizing flow-based generative models with minibatch optimal transport. TMLR, 2024.
Thank you for your detailed reply. Your response helps me understand the inner mechanisms of the method especially for the theory part. I will maintain my postive score.
Thank you for supporting the acceptance of our paper. We are glad our response addressed your concerns. Your comments have helped us strengthen the paper. We sincerely appreciate your time and effort.
We thank the reviewer for the careful assessment and for recognizing velocity coupling as a clear methodological contribution grounded in theory, the framework for studying coupling at multiple levels of a hierarchical model, and the promising few-step and high-resolution results.
QC1: The contribution of velocity OT to the main empirical gains is unclear. On CIFAR-10 at 5 NFE, second-stage training with teacher-generated velocity pairs reaches 6.632 FID without velocity OT, 6.315 with OT, and 22.817 for HRF2-D, so most of the improvement occurs before velocity OT is added. A similar controlled ablation is needed for the headline CelebA-HQ and ImageNet results.
QC2: Theorem 3.2 claims marginal preservation for the continuous-time process in Eq. (6), but Appendix D proves it for discrete updates that sample a conditional velocity at each step. The authors should specify the intended process and revise the theorem or its proof.
QC3: In Eq. (6), is the inner random seed reused throughout the outer trajectory, or is a new seed drawn at each outer step?