- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors propose DiverseFlow, a method for jointly modeling forecast diversity and predictive uncertainty in time-series forecasting by centering multiple plausible horizon forecasts from conditional residual flow matching around a mean horizon.
The mean horizon forecast is obtained by combining two deterministic forecasters, sharing the same backbone but operating on different segments of the time-series history, and the mean of the samples generated from the residual flow process. The weights assigned to each forecast are determined by solving a convex quadratic optimization problem on the validation set.
For horizon generation, DiverseFlow learns residuals relative to the weighted center of the forecast horizons obtained from the two deterministic forecasters (which are pre-trained separately and kept frozen during the flow optimization). To address magnitude variation across datasets and different time periods, which can make optimization harder, residuals are scale-normalized by an element-wise scale parameter s obtained from a conditional scale prediction model that outputs a positive element-wise scale. Scale normalization is applied during training, and the magnitude is restored (by multiplying by s) during sampling.
The authors evaluate the proposed method against deterministic baselines and probabilistic time-series models on eight and six datasets, respectively (with some dataset overlap between the two comparisons). DiverseFlow obtains lower MSE/MAE compared to the reported deterministic baselines and lower CRPS compared to the reported probabilistic baselines in the majority of cases. In addition, the authors quantify the contribution of scale normalization by showing a substantial and consistent degradation in results when removing it. They also show that the ensemble of the flow center and the two deterministic forecasts obtains a lower forecasting error compared to the deterministic ensemble alone.
Critical strengths
- The proposed model outperforms pointwise and probabilistic baselines in the majority of cases across contemporary time-series forecasting benchmarks. The contributions of scale normalization and the flow-based center are empirically demonstrated through ablations.
- The paper is well-structured: the motivation, method, and discussion are clear and overall easy to follow.
Critical weaknesses
- The paper mentions closely related work on probabilistic models for residual generation, such as RDIT, CGFM, and WrapFlow, but these are not included in the empirical comparison. Since these methods appear to be the closest to the proposed work, it is important to benchmark against them or explicitly justify why they are excluded.
- Following from Weakness 1, it is not completely clear what constitutes the core novelty compared to previous work: is it the residual flow matching formulation, its combination with deterministic forecasters, or the introduction of scale normalization? While the authors discuss related work, they do not explicitly expain their conceptual and architectural differentiators.
Questions for authors
- Can the authors please provide an empirical comparison with baselines employing residual generation (e.g., RDIT, CGFM, WrapFlow), or justify why such comparisons are not feasible (see Weakness 1)?
- Could the authors explicitly distill the core technical novelty of their proposed method relative to existing residual-based generative models (see Weakness 2)?
4 comments
Part 2/3 - Quantitative comparisons with CGFM and WrapFlow
Further response to Weakness 1 and Question 1.
CGFM: All four auxiliary-predictor variants. Tables G.3 and G.4 in Appendix G.2 compare MSE and MAE at . CGFM values come from Table 1 of its public paper and cover RLinear, iTransformer, TimeDiff and MultiPatchFormer combined with CGFM. DiverseFlow reports three-seed means from the unified configuration. Published CGFM uses with ten repetitions; DiverseFlow uses two predictors with /.
DiverseFlow has lower MSE and MAE than all four CGFM variants on ETTm1 and ETTm2. For example, ETTm1 MSE/MAE is 0.281/0.339, while the four CGFM variants range from 0.307 to 0.313 in MSE and 0.351 to 0.362 in MAE. DiverseFlow's ETTm2 MSE/MAE is 0.153/0.250. On Traffic, its MSE of 0.372 is also lower than the four CGFM variants' 0.388 to 0.423. The two tables provide complete results on all seven datasets.
WrapFlow: Additional irregular-series tasks. We completed five-seed DiverseFlow adaptation experiments on HumanActivity, USHCN and PhysioNet, using seeds 2024 through 2028. Table G.5 lists their MSE/MAE alongside the means reported in Table 1 of the public WrapFlow paper.
The adaptation interpolates historical observations onto 96 regular grid points. Two independent PatchTST predictors use 96 and 48 points to construct the forecast center. Future targets retain their actual query times, the residual decoder receives future-time information, and losses and metrics are computed at observed targets. Training retains independent scale supervision, residual Flow with the scale frozen, and validation-weighted point ensembling. Appendix G.3 details preprocessing, history lengths and forecast targets.
On HumanActivity, DiverseFlow and WrapFlow both have MSE 0.044 at three-decimal precision, with MAE 0.118 and 0.115, respectively, showing similar MSE performance. Their MSE values are 0.223 and 0.140 on USHCN, and 0.316 and 0.304 on PhysioNet; WrapFlow performs better on these two datasets.
Appendix G thus covers quantitative comparisons with all three related methods: CRPS for RDIT, and the MSE/MAE reported by CGFM and WrapFlow. The CGFM comparison provides a reference for forecast correction on regularly sampled series, while the WrapFlow comparison extends evaluation to irregular series. Captions and notes identify the sources of local experiments, adaptations and published results.
Part 3/3 - Core technical distinctions and their validation
Response to Weakness 2 and Question 2.
DiverseFlow's core design independently supervises an input-dependent residual scale, freezes it to learn the normalized residual distribution, and uses that distribution's sample mean in a validation-weighted point ensemble. This explicitly connects scale modeling, probabilistic generation and point-forecast complementarity. Table G.6 in Appendix G.4 compares the concepts and architectures. The relationships to the three methods are as follows.
Relation to RDIT. RDIT models point estimation and residual diffusion separately, combining residual normalization with distribution calibration. DiverseFlow uses a conditional network to produce elementwise scales from the current history and forecast center, fits them with independent reference CRPS, then freezes them before training the residual vector field in fixed normalized coordinates. Its specific design concerns input-dependent scaling, the scale-supervision objective, and the training order of scaling and residual generation.
Relation to CGFM. CGFM uses an auxiliary predictive distribution as its source, combining historical conditioning and affine probability paths to learn forecast corrections. DiverseFlow starts from noise in the residual space defined by the frozen center and conditional scale , reconstructing predictions as . Its sample mean joins two frozen point predictors in a three-member convex combination with weights fitted on validation data.
Relation to WrapFlow. WrapFlow builds continuous-time residual Flow around base predictions and uses masked-history auxiliary training for irregular observations. DiverseFlow emphasizes independently supervised conditional scaling, a frozen two-predictor center, and a single generated distribution supplying both probabilistic samples and a point-ensemble candidate. The irregular-series adaptation in Part 2 further evaluates this framework on related tasks.
Controlled validation of these designs. Three sets of results in Appendix E address these components:
- Predictive value of conditional scaling: Table E.2. With Flow architecture and training settings fixed, compare unit scale, fixed RMS per channel, fixed RMS per step/channel, and conditional scale. Relative to the finer fixed RMS, conditional scaling lowers CRPS on 8/8 datasets and all 24 dataset-seed combinations, with mean improvements of to .
- Point-forecasting value of generated means: Table E.1. Match conditioning inputs, encoder/decoder, scale, parameter count, initialization and maximum update budget to compare direct MSE residual regression with the Flow sample mean. Flow lowers candidate MSE on 6/8 datasets, and its ensemble lowers MSE on 7/8 under the same validation-weighted procedure.
- Both outputs within one system: Tables E.3-E.5. Samples from the same predictors, center, scale and Flow checkpoints provide probabilistic scores, and their mean enters the point ensemble. Seven datasets simultaneously improve point MSE over the two-predictor center and CRPS over fixed-RMS Flow.
These results connect technical distinctions to evidence: fixed-normalization controls test conditional scaling, matched-capacity residual-regression controls test the complementarity of generated means, and unified evaluation demonstrates their combination within one trained system.
I thank the authors for their detailed response. The additional clarifications and experimental results have largely addressed my concerns. While the new analysis confirms that RDIT is a strong baseline, the proposed method offers a distinct design with convincing overall performance. Accordingly, I will maintain my original positive score.
Part 1/3 - RDIT probabilistic comparisons and a shared-center control
Response to Weakness 1 and the RDIT comparison in Question 1.
Thank you for suggesting comparisons with the closest residual-generation methods. Appendix G of the revision now includes quantitative comparisons with RDIT, CGFM and WrapFlow. Our three-part response covers RDIT, CGFM/WrapFlow, and methodological distinctions with component evidence.
Comparison with published full-RDIT results. Table G.1 in Appendix G.1 reports CRPS at H=96 on eight datasets. RDIT values come from Appendix G, Table 7 of its public paper. DiverseFlow uses the local fixed-center probabilistic configuration and reports three-seed means. Its CRPS on ETTh1 and Solar-Energy is 0.304 and 0.195, respectively, versus published RDIT values of 0.309 and 0.217. RDIT has lower values on the remaining six datasets. The table note specifies data splits, sample counts and integration settings.
Shared-center residual-generation control. To further examine residual generation around point forecasts, we adapt the public RDIT residual network to the same frozen center as DiverseFlow. Both methods share the equal-weight center from two independently trained L=96 PatchTST predictors, with matched H=96, data splits, 64 samples and empirical CRPS. We report three-seed means.
The adaptation combines the shared PatchTST center with ResDiff, training-residual RMS, sample normalization and EAE calibration, using the public reverse-update implementation. Table G.2 reports all three datasets: DiverseFlow and the RDIT adaptation obtain 0.304 and 0.305 on ETTh1, 0.204 and 0.202 on ETTm2, and 0.163 and 0.216 on Weather. The note specifies the adaptation procedure and validation-based checkpoint selection.
These comparisons address two levels of the question. Table G.1 compares DiverseFlow's probabilistic performance with the published full RDIT method. Table G.2 compares residual-generation pipelines with the point-forecast center held fixed. The latter shows a clear CRPS improvement on Weather and provides direct evidence for analyzing the generative component beyond the forecast center. Together, the comparisons establish an empirical connection to this closely related residual-generation method.