- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents CNP-Flow, a flow-matching framework that learns condition-dependent source distributions for temporal generation. Rather than relying on a fixed standard Gaussian source, the method introduces a Conditional Noise Predictor (CNP) that predicts the mean and variance of an isotropic Gaussian distribution conditioned on temporal observations. The proposed training procedure consists of three stages. First, a standard conditional flow-matching model is pretrained. Second, target samples are mapped backward through the pretrained flow to construct supervision for the conditional source predictor. Finally, the flow-matching model is fine-tuned using samples from the learned conditional source distributions. The authors evaluate CNP-Flow on video prediction, video interpolation, and 7-DoF Franka robot motion planning. Additional experiments investigate its applicability to higher-resolution physical world modeling. The results demonstrate substantial improvements in video-generation metrics and promising gains in trajectory validity and end-effector accuracy.
Critical strengths
-
An interesting approach to learning conditional source distributions through flow reversal. Although condition-dependent source modeling has been investigated previously, the use of a pretrained flow model to construct explicit supervision for source prediction offers a meaningful methodological distinction. The three-stage procedure is relatively straightforward and can be applied without modifying the underlying flow-matching backbone.
-
Strong experimental improvements on temporal generation benchmarks. The reported improvements are substantial, particularly on KTH video prediction. The method also outperforms several competing approaches that use structured or learned source distributions.
-
Demonstrated applicability across different generative tasks. The evaluation covers video prediction, interpolation, and robot motion planning. The additional experiments on the ACWM-Phys benchmark provide evidence that the method can also benefit a larger flow-matching transformer under both in-distribution and out-of-distribution settings.
-
Useful ablations and practical efficiency improvements. The authors investigate the contributions of the predicted source mean, source variance, flow-reversal supervision, and backbone fine-tuning. The experiments indicate that source learning contributes to the improvements even when the pretrained flow backbone remains frozen.
Critical weaknesses
-
The novelty relative to existing conditional-source learning methods requires clearer justification. The central idea of learning condition-dependent source distributions for flow matching has already been explored in recent studies, including CAR-Flow (NeurIPS 2025) and Better Source, Better Flow (CSFM, 2026). The main distinctive element of CNP-Flow is therefore its flow-reversal-based supervision. However, the paper could more clearly explain why this supervision provides fundamentally different information from directly learned conditional-source distributions and under which circumstances the additional reversal stage is necessary.
-
The theoretical explanation does not fully establish why flow reversal should produce a useful nontrivial conditional source distribution For an ideal conditional flow that exactly transports a standard Gaussian source to the conditional data distribution, reversing samples from that distribution should recover the original standard Gaussian source. Therefore, the proposed condition-dependent structure in the reversed source distribution appears to depend on properties of the approximate pretrained model, imperfect distribution matching, or finite numerical integration. The paper does not sufficiently explain this distinction or characterize how the benefit of flow-reversal supervision changes as the pretrained flow model becomes more accurate.
-
The contribution of source learning versus simpler conditional initialization strategies remains insufficiently characterized. The ablations compare a standard Gaussian, a deterministic predicted mean, and the complete learned Gaussian. However, simpler alternatives, such as directly predicting a conditional source mean from the temporal observations or using a condition-dependent Gaussian fitted without flow reversal, would help clarify the importance of the proposed supervision mechanism.
-
The motion-planning results are promising but relatively limited in scope. Although the method improves the valid trajectory fraction and end-effector errors, the reported success rate changes only marginally.
Questions for authors
Q1. Relationship to prior conditional-source learning methods. CAR-Flow and CSFM have already investigated condition-dependent source distributions for flow matching. Could the authors clarify the specific advantages of flow-reversal-based supervision over directly optimizing a conditional source distribution? In particular, what properties of the reversed source samples cannot be learned effectively through existing source-alignment or source-regularization objectives?
Q2. Necessity of flow-reversal supervision. Could the authors compare CNP-Flow with a conditional Gaussian source predictor trained through a simpler direct regression or source-alignment objective, using the same network capacity and training budget? This would help clarify whether the improvements come specifically from flow reversal or more generally from learning a condition-dependent source initialization.
Q3. Effect of the source-distribution family. The CNP predicts an isotropic Gaussian source distribution. How sensitive is performance to this assumption, especially when multiple distinct futures are plausible under the same temporal condition? Would a diagonal-covariance Gaussian or a mixture model provide additional benefits?
3 comments
[Q3] How sensitive is performance to source distribution, especially when multiple distinct futures are plausible under the same temporal condition?
We adopt an isotropic Gaussian for its simplicity and computational efficiency. To examine whether more expressive source distributions improve generation quality, we compare diagonal Gaussian, covariance, and a four-component Gaussian mixture (GMM) on BAIR64 1->15. All variants use the same training budgets. We also report LPIPS diversity to evaluate whether more expressive distributions better capture multiple plausible futures.
| Source Distribution | PSNR ↑ | SSIM ↑ | FVD ↓ | LPIPS Diversity ↑ |
|---|---|---|---|---|
| Isotropic Gaussian | 20.15 | 0.839 | 61.17 | 0.0686 |
| Diagonal Gaussian | 20.19 | 0.840 | 61.19 | 0.0686 |
| Covariance | 20.13 | 0.839 | 60.37 | 0.0676 |
| GMM | 20.19 | 0.840 | 61.88 | 0.0681 |
All variants achieve comparable generation quality, with only minor differences across PSNR, SSIM, and FVD. Although covariance improves FVD slightly, it requires approximately 71% additional Stage-2 training time. Moreover, all the other more complex Gaussian variants do not improve LPIPS diversity over our isotropic Gaussian (0.0681 vs. 0.0686). These results show that the isotropic Gaussian is sufficient to provide source expressiveness and maintain a balance between generation quality and computational efficiency.
[W4] The motion-planning results are promising but relatively limited in scope.
Our motion-planning experiment is intended to demonstrate the applicability of CNP-Flow beyond video generation, rather than solely maximizing task-level success rates. In motion planning, success rates are already near saturation (96% vs. 97%), because a task is considered successful if at least one valid trajectory is found among 50 candidates. However, CNP-Flow improves the valid trajectory fraction from 84.9% to 88.5%, and reduces end-effector position and orientation errors by approximately 50%. These results demonstrate that conditional source learning can improve the feasibility and accuracy of robotic motion-planning trajectory beyond video generation.
Thank you for the author's detailed reply. I think it has basically resolved my questions, and I have no further questions.
We thank the reviewer insightful comments. We address the concerns below.
The key insight is that Flow Reversal provides explicit supervision of source locations that are already aligned with real targets through the pretrained FM, rather than requiring the model to discover suitable sources from scratch. Unlike source-alignment or regularization objectives, which indirectly encourage favorable source distributions, Flow Reversal directly identifies source samples that map back to real targets. These samples provide a more informative learning signal, transforming an indirect source-search problem into supervised distribution fitting. While existing objectives may also learn suitable distributions, Flow Reversal offers a more direct learning signal that can facilitate optimization. To show the impact of flow-reversal supervision, we compare CNP-Flow with two simpler conditional-source learning objectives: direct source–target regression and source alignment. All methods use the same fine-tuning budget. To avoid collapse, we add a KL regularization term with coeficient λKL.
KTH 10→30 Results
We tested both arms with different KL regularization. Even with their best-performing settings, both MSE regression and cosine alignment are underperform compared with CNP-Flow in PSNR, SSIM, and FVD. Unlike these geometric alignment objectives, CNP-Flow uses flow reversal to provide explicit source supervision derived from the pretrained FM's transport dynamics.
We agree with the reviewer that, under an ideal conditional FM with exact transport, Flow Reversal should recover the standard Gaussian distribution. However, in practice, the reversed source distribution may deviate from the standard Gaussian due to pretrained model approximation errors and numerical integration errors. Since the underlying conditional data distribution and exact transport map are generally intractable, precisely disentangling and quantifying these error sources is challenging. Nevertheless, we empirically investigate how the quality of the Stage-1 pretrained FM affects downstream CNP-Flow performance by evaluating checkpoints from different training stages while keeping the Stage-3 training budget fixed.
The results show that longer Stage-1 pretraining consistently improves downstream FVD (66.18 → 62.36 → 61.10), while CNP-Flow remains effective even with relatively early pretrained checkpoints.
To investigate the impact of pretrained FM quality, we evaluate different Stage-1 checkpoints while fixing the Stage-3 training budget at 50k iterations.
CNP-Flow consistently outperforms the fixed-Gaussian baseline across all checkpoints, achieving relative FVD improvements of 25.2%, 9.1%, and 7.7%, respectively. These results demonstrate that the benefits of CNP-Flow persist across different levels of pretrained FM quality.