- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper is concerned with the challenge of forecasting from historical data. The authors choose the Koopman operator formalism for describing spatiotemporal dynamics, and address the issues that arise from approximating this operator in finite dimensions. They note that forecasts from different start states may end at different locations despite deterministic underlying dynamics due to the propagation of errors, resulting in a distribution of degraded states that is a mixture of Gaussians.
They then introduce a procedure for correcting these errors, drawing on flow matching to learn the reverse stochastic process corresponding to the degradation. They demonstrate that this approach improves forecasting performance, both on train data and out of distribution data, compared to a variety of methods. They further analyze the effects of their hyperparameter choices (Koopman training horizon, propagation window, correction starting point) to assess and justify their experimental choices.
Critical strengths
This paper was well-written and very easy to read and understand the author's motivations and problem formulation. The primary strengths are:
- Well-grounded motivation, and a clever application of flow-matching to an important problem: data-driven approximation and forecasting of nonlinear, deterministic dynamics. Section 3.3 in particular sets the framing for the paper well, providing a solid justification for using flow matching to reverse the progressive degradation.
- A thorough set of experiments demonstrating the efficacy of this framework, especially on test set forecasting. The experiments exploring the effects of various hyperparameter choices and inference times are helpful as well.
Critical weaknesses
The main weaknesses of this paper are:
- The related work section. While there is a section on generative modeling, this is a straightforward application of flow matching methods, and they should be covered in depth. Particularly relevant are Flow Matching for Generative Modeling (Lipman et al., 2023) and Flow straight and Fast: Learning to Generate and Transfer Data with Rectified Flow (Liu, Gong, & Liu 2022).
- A lack of discussion of the implications of the Gaussianity assumption on errors. While the method clearly works, it would be helpful to give readers an understanding of how well this Gaussian characterization holds in practice (for instance, by fixing the Koopman dynamics and propagating errors forwards to create a rollout error distribution). This could also help give a better intuition for why different flow start points perform better at different propagation horizons.
Questions for authors
- How well does the Gaussianity assumption hold in practice?
- Do you an intuition for why Koopman training at moderate training horizons vs. shorter or longer horizons is better?
- What was the dimensionality used for Koopman embeddings in your experiments? Did you try different dimensionalities, and how did that interact with the effect of training horizons & the flow stage?
- What is the procedure for recursive correction? I couldn't find where it's explicitly defined in the paper.
4 comments
[Q3] What was the dimensionality used for Koopman embeddings in your experiments? Did you try different dimensionalities, and how did that interact with the effect of training horizons & the flow stage?
Response: We thank the reviewer for this helpful suggestion. We clarify the embedding dimension used in our original experiments and have added an ablation study to investigate its interaction with the training horizon and generative correction.
-
All experiments reported in the original manuscript used a 128-dimensional Koopman embedding.
-
We have evaluated embedding dimensions () across Koopman training horizons (). The results show that an intermediate embedding dimension and training horizon ( and ) yield the best overall performance after generative correction. This suggests that neither increasing the embedding dimension nor extending the training horizon alone necessarily improves the final KoopFlow performance. Moreover, generative correction consistently reduces prediction errors across all tested combinations of embedding dimensions and training horizons, demonstrating its effectiveness under different configurations. Due to time constraints, this ablation was conducted only on the Navier--Stokes dataset.
We have added this experiment to the revised manuscript, included further analysis of the underlying reasons in Appendix H.1, and plan to extend the evaluation to other datasets in future work.
| Koopman NMSE | KoopFlow NMSE | |||
|---|---|---|---|---|
| 2 | 32 | 3.710e-01 | 4.534e-02 | 28.2 |
| 2 | 64 | 7.287e-01 | 1.355e-01 | 59.6 |
| 2 | 128 | 4.691e-01 | 5.523e-02 | 236.6 |
| 2 | 256 | 3.887e-01 | 5.939e-02 | 296.4 |
| 7 | 32 | 1.627e-01 | 3.586e-02 | 5.4 |
| 7 | 64 | 6.817e-02 | 2.326e-02 | 23.9 |
| 7 | 128 | 1.406e-01 | 3.075e-02 | 144.8 |
| 7 | 256 | 9.225e-02 | 2.588e-02 | 150.0 |
| 12 | 32 | 8.859e-02 | 3.526e-02 | 28.5 |
| 12 | 64 | 5.851e-02 | 3.161e-02 | 93.1 |
| 12 | 128 | 8.296e-02 | 2.489e-02 | 88.1 |
| 12 | 256 | 2.680e-01 | 3.360e-02 | 184.9 |
[Q4] What is the procedure for recursive correction? I couldn’t find where it’s explicitly defined in the paper.
Response: We thank the reviewer for this comment. This procedure divides a forecasting horizon into segments. At the end of each segment, generative correction is applied to the Koopman prediction, and the corrected latent state serves as the initial condition for the next Koopman rollout. We have added this explicit description and clarified the meaning of in the ablation study accompanying the revised manuscript.
We hope our responses have addressed your questions, and we welcome further feedback.
I thank the authors for their thoughtful responses, both to myself and the other reviewers. It's clear that they have considered the suggestions and questions provided carefully, and have performed a thorough set of experiments to bolster their results as well as proposed edits to improve the clarity of presentation. I am updating my score accordingly, to recommend a clear accept.
Dear Reviewer WTd1,
We are pleased that our responses have addressed your concerns. We sincerely thank you for raising your score and for your insightful comments and constructive suggestions!
We sincerely appreciate your careful review and insightful comments, as well as your positive remarks on the clarity of our presentation, the well-grounded motivation and clever application, and the solid experimental evaluation. We address the concerns point by point below.
[W1] The related work section. While there is a section on generative d’samodeling, this is a straightforward application of flow matching methods, and they should be covered in depth. Particularly relevant are Flow Matching for Generative Modeling (Lipman et al., 2023) and Flow straight and Fast: Learning to Generate and Transfer Data with Rectified Flow (Liu, Gong, & Liu 2022).
Response: We thank the reviewer for this comment. We have expanded the discussion of Flow Matching in the Related Work section following your suggestion.
[W2/Q1] A lack of discussion of the implications of the Gaussianity assumption on errors. How well does the Gaussianity assumption hold in practice?
Response: We thank the reviewer for this constructive suggestion.
We further validate the zero-mean Gaussian assumption through additional experiments. Specifically, we projected Koopman-induced residuals from held-out Navier–Stokes trajectories onto the first three principal directions at different prediction horizons.
As shown in the table below, the residual means remain close to zero, the directional variances generally increase with the prediction horizon. Moreover, 18 of the 21 Shapiro–Wilk tests [1] do not reject the Gaussian hypothesis at the 5% significance level. These results support the reasonableness of modeling errors using Gaussian approximation with variance increasing with the prediction horizon.
We have added Gaussian validation results in the revised manuscript. Visualizations of the residual distributions and their horizon-dependent statistics are provided in the Appendix H.1 (Figure 10). Furthermore, the Q-Q plots provided in Appendix H.1 (Figure 11) offer additional support for the Gaussian assumption.
[1] Shapiro, S. S., and Wilk, M. B. An analysis of variance test for normality (complete samples). Biometrika, 1965.
[Q2] Do you an intuition for why Koopman training at moderate training horizons vs. shorter or longer horizons is better?
Response: We thank the reviewer for raising this question. From a spectral perspective, we interpret the effect of the training horizon as a trade-off between eigenbasis conditioning and predictive fidelity within a fixed-dimensional latent space.