- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces Dual Flow Matching (DualFM), which jointly predicts the velocities of two independently corrupted views of the same target using a single shared backbone. Training uses independent noise sources and independent clocks for the two views, while inference synchronizes the clocks and jointly evolves both states, returning one output branch.
The paper provides a statistical motivation based on reduced conditional regression risk when an auxiliary observation is available, a common/difference-coordinate analysis of the synchronized joint flow, and an exact common-task excess-risk identity for comparison with single-state flow matching. Empirically, the method is evaluated on MNIST, CIFAR-10, ImageNet32, and class-conditional ImageNet64, including UNet and SiT-XL/4 backbones. The authors also provide controls for parameter count, source variance, observation information, cross-view interaction, training clocks, target correspondence, and minibatch OT coupling, together with diagnostics of target reconstruction and branch agreement.
The results suggest that explicitly coupling two noisy views of the same instance can improve finite-network flow estimation and multi-step generation at very small additional backbone cost.
Critical strengths
-
The empirical controls are unusually thorough. The authors do not merely compare DualFM with ordinary I-CFM. They separately control for parameter count, source variance, posterior observation information, number of processed states/targets, clock synchronization, and exact instance correspondence. The information-matched I-CFM control is particularly useful because it shows that the improvement cannot be explained solely by the additional posterior information contained in two noisy observations.
-
The method provides consistent gains at very small backbone overhead. On CIFAR-10 and ImageNet32, DualFM improves mean FID over three training seeds across essentially all practically relevant sampling budgets. The gains also appear with SiT-XL/4 on ImageNet64 and when combined with minibatch OT coupling. The reported parameter and forward-compute increases are negligible, making the method practically attractive.
Critical weaknesses
-
Independent-clock training does not theoretically determine the synchronized inference field. The method trains on a two-dimensional clock distribution but evaluates only the one-dimensional diagonal . The paper's transport argument describes the canonical conditional-mean field restricted to this diagonal, but that value is not uniquely specified by minimizing an almost-everywhere two-clock regression objective. The authors provide empirical diagonal diagnostics, which mitigate the concern, but the theoretical justification of the actual train-to-sample procedure is incomplete.
-
The distinction from the closest existing paired-view method would benefit from stronger empirical support. The paper identifies DUPA as closely related: it also independently corrupts the same image at multiple noise levels and supervises multiple velocity predictions. DualFM differs importantly by allowing full cross-view conditioning and by jointly evolving the two states at inference rather than using a feature-alignment loss. However, there is no direct empirical comparison. Since this is the closest conceptual prior work, such a comparison would materially clarify the practical novelty of DualFM.
A secondary limitation is scale. The larger SiT-XL/4 experiment is encouraging but uses ImageNet64 and a single training seed. Thus the evidence for scaling to modern high-resolution generative settings remains preliminary.
Questions for authors
-
Training/inference mismatch: Since independent continuous clocks assign probability zero to the diagonal , the training risk does not uniquely determine the field used during synchronized inference. Can the authors provide a stronger argument for why independent-clock training should recover the desired diagonal conditional field, beyond architectural continuity and the empirical diagnostics? For example, is there a regularity argument that controls diagonal error from nearby off-diagonal training error?
-
Closest baseline: How does DualFM compare directly with DUPA under a matched backbone and training budget? I understand the conceptual distinction between feature alignment and full joint conditioning, but a controlled comparison would materially help assess whether joint prediction and joint inference provide a meaningful advantage over the closest existing paired-view approach.
-
Scaling: The ImageNet64 SiT-XL/4 result uses one training seed. Do the authors have additional evidence that the improvement is stable at this scale, or results at higher-resolution ImageNet/text-to-image settings? This is not necessary for establishing the small-scale result, but it would affect how broadly I interpret the contribution.
3 comments
Thank you for the additional experiments. The continuity argument addresses my theoretical concern at the population optimum, and the matched DUPA comparison strengthens the evaluation, although it remains limited to a single run. The new ImageNet64, ImageNet256, and Heun results also provide useful evidence of generalization, despite the unmatched high-resolution baseline. The authors have addressed most of my concerns, and I am satisfied with the response. I will maintain my score.
Thank you for taking the time to review our responses and the additional experiments. We appreciate your constructive feedback, which has helped us improve the manuscript.
Response to Reviewer RU8N
We thank the reviewer for the constructive feedback. We address the training–inference question, the DUPA comparison, and scaling below.
1. Independent-clock training and synchronized inference (W1 / Q1).
At the ideal population optimum, independent-clock training identifies the synchronized field within the class of continuous predictors. Let Q=(Xt,Hs,t,s), U denote the paired target velocities, and f∗(Q)=E[U∣Q] be the canonical conditional-mean field. Gaussian corruption and independent uniform clocks give the training distribution full support for 0<t,s<1. The Gaussian posterior mean, and hence f∗, is continuous on this domain for our bounded image data.
Proof. Squared regression gives
=\mathbb{E}\left[\lVert f(Q)-f^{\ast}(Q)\rVert^{2}\right].$$ A continuous predictor attaining the Bayes-optimal population risk therefore agrees with $f^{\ast}$ almost everywhere. If it differed at a diagonal point, continuity would make the difference nonzero in an open neighborhood. Full support gives that neighborhood positive training probability, contradicting optimality. Thus $$f(x,h,\tau,\tau)=f^{\ast}(x,h,\tau,\tau), \qquad 0 < \tau < 1.$$ The diagonal restriction is therefore exactly the conditional-mean field used in our synchronized transport result. Empirically, our synchronized diagnostics show lower reconstruction error at all five evaluated times on both CIFAR-10 and ImageNet32. Independent-clock training also outperforms synchronized-clock training at all four tested CIFAR-10 sampling budgets (revised Table 5). **2. DUPA comparison and training compute (W2 / Q2).** We evaluated a UNet adaptation of DUPA on ImageNet32 using the same backbone architecture as DualFM, Euler sampling, and FID-50k from EMA checkpoints. With the same batch of clean targets, DUPA requires approximately twice the training FLOPs per update of DualFM. Thus, DUPA at 300k updates approximately matches the training compute of DualFM at 600k; DUPA at 600k uses approximately twice that budget. Compute here denotes training forward/backward FLOPs. The I-CFM and DualFM entries below use the paper's seed-42 runs. Training compute is normalized to DualFM at 600k updates. | Method / updates | Training compute | NFE 2 | 5 | 10 | 20 | 50 | 100 | |---|---:|---:|---:|---:|---:|---:|---:| | I-CFM / 600k | ~1x | 199.123 | 46.216 | 20.045 | 13.495 | 10.754 | 9.755 | | DualFM / 600k | 1x | 174.343 | 44.590 | 19.472 | 12.602 | 10.000 | 9.238 | | DUPA / 300k | ~1x | 195.128 | 45.217 | 19.691 | 12.971 | 10.304 | 9.487 | | DUPA / 600k | ~2x | 196.237 | 44.583 | 19.439 | 12.682 | 9.705 | 8.983 | At approximately matched training FLOPs, DualFM has lower FID than DUPA at all six evaluated sampling budgets. With approximately twice the training compute, DUPA at 600k achieves lower FID at NFE 5, 10, 50, and 100, while DualFM remains better at NFE 2 and 20. These are single-run comparisons. **3. Stability and higher-resolution generation (W3 / Q3).** We added a second ImageNet64 training run for both methods, with the same class-conditional SiT-XL/4 backbone and 1.2M updates. DualFM achieves lower FID in both runs at every sampling budget. Below are means ± sample standard deviations over the two runs (revised Table 2(b)). | ImageNet64, SiT-XL/4 | 10 NFE | 20 NFE | 50 NFE | 100 NFE | 1000 NFE | |---|---:|---:|---:|---:|---:| | I-CFM | 12.058 ± 0.103 | 8.312 ± 0.050 | 6.615 ± 0.033 | 6.042 ± 0.009 | 5.621 ± 0.089 | | DualFM | **11.550 ± 0.018** | **7.541 ± 0.165** | **6.279 ± 0.006** | **5.851 ± 0.018** | **5.414 ± 0.098** | We also evaluated class-conditional latent-space generation on ImageNet256 with SiT-XL/2 at 400k updates. DualFM obtains 16.7 FID versus 18.8 for the published SiT baseline. Both use Euler-250, 50k samples, and the ADM evaluation protocol (revised Table 2(c)). | ImageNet256, latent SiT-XL/2 | FID ↓ | |---|---:| | SiT baseline, Gao et al. (2025), Table 5 | 18.8 | | DualFM | **16.7** | These results extend the evidence to two training runs at the larger pixel-space scale and to high-resolution latent generation.