- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces ReCouple, a blockwise OT coupling framework for rollout-free flow-matching post-training. ReCouple+ increases source resolution, and ReCouple++ adds annealed spatial regularization. Theoretical analysis and experiments show that coupling refinement affects generation differently across sampling budgets.
Critical strengths
- The framework separates transport geometry, source resolution, and spatial regularization, providing a useful way to study coupling design. The convergence analysis clearly distinguishes global SDOT from the fixed-block limit and makes the approximation's scope explicit.
- The CIFAR-10 experiments include two pretrained backbones and three training seeds. The ablations demonstrate a useful NFE-dependent trade-off: increasing source resolution can improve higher-NFE performance while worsening one-step generation. This supports the practical insight that endpoint transport cost alone is insufficient to rank trained generators.
Informativeness: The controlled coupling hierarchy provides useful insight into how transport resolution interacts with the sampling budget.
Overall assessment: The explicit coupling hierarchy, convergence characterization, and systematic NFE-dependent ablations provide useful methodological and empirical insight. These contributions support acceptance, while the remaining concerns limit the strength of the mechanistic explanation and component-level performance claims.
Critical weaknesses
- The scope of the mechanistic explanation should be clearer. Equation (7) assumes a smooth positive-density state distribution, whereas training uses fixed discrete pair banks. Its connection to these experiments remains heuristic. Measurements of finite-resolution ambiguity or learned spatial Jacobians would strengthen this interpretation.
- Additional controls would clarify the contribution of each component. Baselines with the same spatial penalty are missing. On ImageNet at NFE 10, FID improves from 10.637 for ReCouple to 7.051 for ReCouple-AS, while ReCouple++ reaches 6.960 (Table 4). The regularization benefit is encouraging, but the incremental benefit of pooling needs uncertainty estimates, and its advantage over regularized alternatives remains open.
Soundness: The main concerns involve mechanistic interpretation and attribution of gains. The coupling construction and the observed NFE-dependent trade-offs are reasonably supported.
Questions for authors
- Could the authors clarify the applicability of Equation (7) to discrete training banks and the evidence supporting the spatial-realizability explanation?
- Are results available for minibatch OT or SD-FM with the same regularization and comparable computational budgets?
- What is the run-to-run uncertainty of the ImageNet improvement over ReCouple-AS?
Thank you for your review
Thank you for your positive feedback and constructive suggestions, which have helped us improve the manuscript. We have uploaded a revised version, with all changes highlighted in blue. We have also rerun the ImageNet-256 experiments with the public SiT-XL/2 flow matching backbone, a common Euler sampler and evaluator, 50K generated images per evaluation, and both CFG 1.5 and 4. The revised Sec. 4.3 (Tables 4–6) now contains full NFE sweeps and a complementary fixed-6K, three-training-seed NFE-10 comparison; App. E.4 (Tables 17–21) reports matched regularized controls, precision/recall, Jacobian diagnostics, and cost.
Equation (7) and empirical-bank applicability. Equation (7) is a fixed-time population small-noise expansion under a smooth positive-density state law, finite Fisher information, and bounded field derivatives (Sec. 3.3; App. D.6). It is not asserted for an atomic training bank: In a finite bank of affine paths, two paths with different velocities can coincide at at most one time, so conditional velocity ambiguity vanishes almost everywhere in time. This is precisely why we introduce finite-resolution risk and a separate learned-field penalty. As empirical evidence, our common-query Jacobian measurements show that AS reduces the estimated squared guided-field Jacobian norm for ReCouple at t=0.9 from 15.459 to 3.729 (CFG 1.5) and 16.764 to 4.161 (CFG 4) (App. E.4, Table 20). CFG-1.5 FID nevertheless worsens at that checkpoint (Table 19). The diagnostic supports the intended control of learned-field spatial variation, without claiming that the population expansion applies directly to atomic banks or that lower Jacobian norm guarantees lower FID.
Regularized alternatives and compute. The matched OT+AS and SD-FM+AS controls and their FIDs are now provided in App. E.4, Table 17; the separate active-penalty results appear in Table 19. Regularized post-training requires extra network evaluations: the ImageNet timings are 3.780 versus 6.192 hours for minibatch OT without/with AS and 4.248 versus 5.489 hours for SD-FM (Table 21) on an NVIDIA GH200.
Uncertainty of the pooling increment. In the three-seed NFE-10 ImageNet comparison, for the paired contrast Δ=FID(ReCouple++)−FID(ReCouple-AS), the mean differences are +0.036 at CFG 4 (with 95% confidence interval [−0.081, +0.153]) and +0.020 at CFG 1.5 ([−0.447, +0.487]). Neither interval establishes an incremental advantage from pooling at this checkpoint. The intervals reflect three paired optimization seeds and are not uncertainty estimates for the NFE sweeps (App. E.4, Table 17).