- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the use of externally predicted quantiles to guide diffusion-based forecasting. The author proposes Control-TS, which introduces a trainable residual control pathway into a frozen pretrained diffusion backbone. Experiments shows that Control-TS outperforms to baselines like TSDiff, with additional analyses of model capacity, quantile granularity, robustness, and computational overhead.
Critical strengths
S1: Clear motivation and good writing. The paper identifies meaningful connections between explicit quantile forecasts and diffusion-based generation. The Comparison of different integration strategies provides useful empirical insights into how external predictive information can guide diffusion models.
S2: Extensive evaluation. The paper use eight benchmarks to evaluate the performance of Control-TS. The capacity-matched comparisons, additional backbone experiments, and robustness analyses strengthen the empirical evidence.
Critical weaknesses
W1: Limited evaluation under multivariate and long-horizon forecasting. The main experiments focus on univariate forecasting with relatively short prediction horizons (24–48). Although additional multivariate experiments are provided using MG-TSD, improvements are observed on only five of eight datasets. The lack of evaluation on widely adopted benchmarks such as ETT under longer prediction horizons limits the evidence for the method's broader applicability.
W2: Insufficient isolation of the benefits of quantile-specific uncertainty information. Although the experiments suggest that multiple quantiles can improve forecasting performance, increasing the number of quantiles also changes the dimensionality of the control input. Therefore, it remains unclear how much of the improvement comes specifically from uncertainty information rather than the additional input representation. Given that the proposed residual controller are similar to ControlNet-style architectures, stronger evidence isolating the quantile-specific contribution would help establish the methodological novelty.
Questions for authors
1.Quantile information: Can the authors further clarify whether the performance gains come from the additional uncertainty information provided by multiple quantiles, rather than simply using more input features? 2.Generalization: Could the authors provide additional experiments on standard long-term forecasting benchmarks, such as ETT? 3.CLPS evaluation: What additional insights does CLPS provide compared with conventional forecasting metrics? Could the authors further clarify its advantages and limitations?
We thank the reviewer for recognizing the motivation, clarity, and breadth of our evaluation. We appreciate the suggestions on isolating uncertainty information and extending evaluation to longer horizons.
Comment: Regarding uncertainty information versus additional input features.
Response: The submitted observed-context ablation partially addresses this concern by repeating history across one, three, or five channels with the same controller architecture (Section 3.3 and Appendix B.11). We agree that further isolation requires controls based on predicted futures.
We trained controllers using three or five repetitions of the predicted median, matching the input widths of Q3 and Q5. This holds the number of conditioning channels fixed while replacing the additional quantiles with the same point forecast. We also evaluated mean-variance controls to compare predicted quantile trajectories with a summary of predictive location and scale.
The table reports the mean dataset-level CRPS reduction (%) of Control-TS over each new alternative, across all eight datasets. Positive values indicate improvement by Control-TS.
Control-TS outperforms both alternatives on average for Q3 and Q5. The channel-matched repeated-median comparison supports the value of uncertainty information beyond simply increasing the number of conditioning channels, while the mean-variance comparison further supports the usefulness of the quantile representation. We will include the results and precise control constructions in the revised paper.
Comment: Regarding long-horizon and multivariate forecasting.
Response: We appreciate this suggestion. We extended the evaluation to multivariate forecasting on ETTh1 and ETTm2 at horizons of 96 and 192. The table reports the relative CRPS reduction (%) achieved by Control-TS over the MG-TSD backbone, positive values indicate improvement.
Control-TS improves CRPS in all four settings, by 8.89-31.10%, providing additional evidence of its applicability to longer-horizon multivariate forecasting. Results average three sampling seeds per fixed trained checkpoint, with 100 forecast paths per test window.
This probabilistic evaluation is computationally demanding: each test window requires generating 100 complete multivariate trajectories through iterative diffusion. We therefore extended the original setting to horizons of 96 and 192 within the available budget. We will include the full protocol and distinguish these additional multivariate results from the original univariate evaluation in the revised paper.
Comment: Regarding the additional insights, advantages, and limitations of CLPS.
Response: Thank you for this question. CLPS measures transferable forecasting utility: can a separate predictor learn useful context-future relationships from generated training targets and generalize to real observations? (Section 3.5 and Appendix B.16).
This provides information beyond directly scoring the generator’s forecasts. Indeed, Control-TS improves direct forecasting CRPS on all eight datasets, but improves CLPS on six, with small regressions on Electricity and UberTLC (Table 4). Thus, better forecast accuracy does not necessarily translate into better training targets for this downstream learner.
The advantages are inexpensive, deterministic, closed-form ridge fitting without backpropagation, reproducibility across hardware up to floating-point differences, and a controlled comparison with fixed training contexts and evaluator. Table 4 additionally includes DeepAR and TFT evaluators to examine whether the findings extend beyond a linear predictor.
The limitation is that CLPS measures utility accessible to the chosen evaluator, rather than complete distributional fidelity. Its deterministic predictions make the reported CRPS equivalent to normalized absolute error. Consequently, CLPS does not directly establish uncertainty calibration or cross-horizon dependence. Its additional information comes from the train-on-generated-targets, test-on-real-data protocol, not from a different error formula. We will further clarify this scope in the main text.
We appreciate the reviewer’s feedback and hope our clarifications and additional evidence resolve their concerns. If so, we hope that the reviewer would consider raising their score.