- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a method for probabilistic forecasting, that uses flow-matching forecasting to model the conditional distribution of future trajectories. It does this via two stages: conditional flow matching to learn the predictive distribution of future trajectories, followed by a calibration step, where an optimal control inspired term is used to improve the forecasts. For the first step, an iTransformer-style variate encoder is used, to capture cross channel dependencies. The method uses historical patches, small sampled sequences used as input for the flow-matching forecaster (instead of pure Gaussian samples). This is then trained in the same style as Conditional Flow Matching (CFM). For the second stage, an optimal control problem is formulated by creating an ensemble of K trajectories from different initial conditions, and integrating their flows. The control problem is not solved directly, but a neural controller is trained for gradient matching on the CRPS gradient. This then steers the ensemble members to solutions that improve the quality of the predictive distribution, while penalizing control cost. The proposed method is evaluated on the standard real-world forecasting datasets, and ablates the historical patches and the effect of the calibration step.
Critical strengths
Promising direction: Connecting optimal control-based calibration of probabilistic forecasting is an interesting approach that I could see make a positive impact. Probabilistic forecasting is useful in many real-world forecasting tasks, where the additional probabilistic information is preferred over a deterministic prediction. Providing calibration for these types of models with a similar method to VGG Flow makes for an interesting direction that can improve probabilistic forecasting.
Critical weaknesses
-
Limited Novelty: The two main novelty claims rely on redesigning of the sampling strategy of flow matching, and the calibration of the model via optimal control refinement strategy. For the first, many of the proposed contributions are already existing concepts: conditional flow matching already introduces the training objective, using transformers for the velocity field is common practice, and the history context encoding follows the iTransformer style of variate encoder. While these are interesting ideas, their specific combination does not form a major contribution on its own. For the second claimed novelty regarding optimal control, the formulation of the optimal control on the particles is quite closely related to VGG Flow (Liu et al., 2025), and also seems to closely align with the OC-Flow method ("Training Free Guided Flow Matching With Optimal control" by Wang et al., ICLR 2025). VGG Flow learns a value gradient, and OC-Flow uses co-states from Pontryagin minimum Principle. While neither of these works exactly address the ensemble setting in forecasting, the novelty remains limited.
-
Lack of ensemble theory: For a set of ensemble members, the ensemble optimality condition should ideally be applied to the entire set of particles/samples, but currently, each ensemble member has its own optimal control applied without considering the state of the other members. From a theoretical perspective, this seems to be best fitted as a mean field optimal control problem, but it is not linked to this. For probabilistic forecasting, this would concretely mean that the control should consider the joint states of all the ensemble members. It would be good to clarify what the calibrated distribution looks like.
-
Experimental: lack of error bars in the main comparisons: The main comparisons (table 1 and 2) do not provide error bars, meaning that every reported value could have been lucky initialization. Without the error bars, the main study results cannot be interpreted as evidence for the claimed improvements. For inspiration, related probabilistic flow-matching forecasting works report results over multiple seeds: ("Flow Matching with Gaussian Process Priors for Probabilistic Time Series Forecasting", Kollovieh et al., ICLR 2025). Related, the main result table 1 reports MSE and MAE metrics that in my opinion are not well-suited for a paper that addresses probabilistic forecasting, since these do not reflect the uncertainty of the model.
-
Experimental: lack of flow-matching baselines: The paper cites several related works (e.g. TSFlow) that also apply flow-matching for probabilistic forecasting, however these are not reflected in the baselines. These would be important additions for a proper claim on improving performance over related works.
As more minor point, figure 2 is missing basic features such as labels on the x and the y axis.
Questions for authors
- Are you able to provide error bars for table 2? It would be important to see if the claimed effect can be reproduced over multiple runs, both for your proposed method as well as for the baselines.
- Could you include flow-matching baselines for probabilistic forecasting to the main comparison in table 2?