W1. Limited theoretical and methodological novelty.
My primary concern is that the paper does not sufficiently distinguish its contributions from established and recent work in probabilistic decision-focused learning. Learning a probabilistic predictive model by differentiating cost is already established in Donti et al. Therefore, the characterization in Section 6 that existing decision-focused learning approaches target point predictions is inaccurate when applied to this work.
Moreover, decision-aware fomulation is closely related to the well-established notion of decision regret. In decision-focused learning, regret is commonly defined as the realized cost of the forecast-induced optimal action relative to an oracle action with perfect foresight. Therefore, using the realized optimal-action cost as an objective is not a fundamentally new paradigm.
In particular, Stratigakos et al. already formulate a decision-aware forecasting objective combining decision regret with CRPS. Imporantly, their decision regret is defined as the realized cost of the forecast-induced optimal action minus the perfect-foresight optimal cost. Since the latter is independent of the predictive model, minimizing this regret is equivalent to minimizing the optimal-action cost proposed in the present paper. Thus, the proposed decision loss appears to be a reformulation of an established regret-based objective.
I acknowledge that two works differ in their model parameterization. Nevertheless, since the paper positions its decision-aware training framework as a central methodological contribution, the novelty of this claim appears overstated. Extending an established regret-based objective to different generative architectures does not, by itself, constitute a fundamentally new training principle. While its implementation for sample-based generative models may offer practical value, the paper does not sufficiently distinguish such an extension from a substantive methodological advance.
The absence of a discussion of this closely related work in Section 6 further weakens the novelty justification. The authors should clarify which aspects of the proposed training methodology are genuinely novel beyond adapting an existing decision-focused objective to sample-based generative models.
W2. Insufficient comparison with closely related forecasting and decision-focused learning methods.
Although the authors include an energy-score-only baseline (wd=0), this primarily serves as an internal ablation rather than a comparison with existing decision-aware forecasting approaches. Diffusion-DFL provides a closely related approach that trains diffusion models for downstream stochastic optimization using generated samples. Despite differences in architecture and gradient estimation, adapting this method to the same decision tasks would provide a meaningful comparison of downstream decision quality, forecasting accuracy, and computational efficiency. Without such a comparison, it is difficult to establish the practical advantages of the proposed decision-aware training framework over existing diffusion-based decision-focused learning approaches.
Furthermore, although the Introduction motivates the proposed framework through recent advances in probabilistic weather forecasting, Section 6 largely omits the corresponding forecasting literature. Existing weather forecasting approaches and their training objectives are cited in the Introduction and background but are not adequately discussed or positioned in the Related Work section. Given that the paper explicitly targets probabilistic forecasting applications, a more comprehensive discussion of this research context is necessary to clarify how the proposed decision-aware training differs from and complements established forecasting methods.
I encourage the authors to strengthen both the experimental comparisons and the related-work discussion to better establish the practical significance and positioning of the proposed framework.
W3. Insufficient evidence of practical benefits and general-purpose forecasting utility
One of the primary advantages of probabilistic forecasting is that a single predictive distribution can support multiple downstream decisions. Once a sufficiently accurate conditional distribution is learned, different decision-makers can compute their optimal actions from generated samples without retraining the forecasting model.
In contrast, the proposed approach incorporates a particular decision cost directly into the generative-model training objective. This may specialize the learned predictive distribution to a specific downstream task. Although the exact population-level objective remains strictly proper, this does not guarantee that the pratically learned distribution retains it utility across other decision problems. A direct cross-deicision evaluation would be informative. This would clarify whether method learns generally useful probabilistic forecasts or primarily task-specific decision representations.
W4. Misalignment of the decision-calibration metric with its formal definition
Section 3, Eq. (3), defines decision calibration through equality between the predicted expected decision cost and the realized decision cost in expectation.
However, the reported decision-miscalibration metric averages the absolute difference between the predicted expected cost and each individual realized cost:
\left|
\mathbb{E}{Y\sim\widehat F{x_i}}
[c(a_i^,Y)]
-c(a_i^,y_i)
\right|.$$
This metric is not a consistent measure of the calibration discrepancy defined in Eq. (3). In particular, it includes irreducible outcome variability even when the predictive distribution is perfectly calibrated.
More importantly, the metric can assign a strictly better score to a systematically miscalibrated forecast than to the true distribution.
For example, consider the squared-error decision cost $c(a,y)=(a-y)^2$, with the true distribution
$$p=0.75\delta_0+0.25\delta_1$$
and an incorrect predictive distribution
$$q=0.5\delta_0+0.5\delta_{0.5}.$$
Both distributions induce the same Bayes-optimal action, $a^*=0.25$, and therefore the same realized decision costs. Nevertheless, the expected absolute cost discrepancy used in the paper equals $0.1875$ for the true distribution and $0.125$ for the incorrect distribution.
Thus, the reported metric favors the incorrect distribution despite its nonzero expected-cost calibration error.
The reported improvements in decision miscalibration are central to the empirical conclusions, particulary because aggregate decision costs remain largely unchanged in the real-world experiments.
In Section 5.2, the aggregate wind-power decision loss is relatively flat across decision-loss weights, while the highlighted improvements are concentrated in regions conditioned on realized wind-speed outcomes. Similarly, in Section 5.3, the aggregate frost-protection decision loss remains mostly unchanged, while the energy score can deteriorate with increasing decision-loss weight.
Consequently, the current experimental results do not convincingly demonstrate substantial improvements in overall downstream decision quality.
References Relevant to the Review
Donti, P., Amos, B., & Kolter, J. Z. (2017). Task-based End-to-end Model Learning in Stochastic Optimization. NeurIPS.
Stratigakos, A., Pineda, S., & Morales, J. M. (2025). Decision-focused linear pooling for probabilistic forecast combination. International Journal of Forecasting, 41(3), 1112–1125.
Zhao, Z., et al. (2026). Diffusion-DFL: Decision-focused Diffusion Models for Stochastic Optimization. ICLR.
Author-Reviewer Discussion ends in 1 day, 12 hours
Dear authors and reviewers,
The discussion period closes in about a day and a half, so this is the last chance for a direct exchange before the reviewer-AC discussion starts on Nov 19.
Authors: I have not yet seen a response to the reviews. Please post a rebuttal addressing the reviewers’ main concerns, focusing on the points most likely to affect the decision. If you update the manuscript, a short summary of the changes would help reviewers.
Reviewers: please read the authors’ response once it is posted and let us know whether your concerns have been addressed. Please update your recommendation if your assessment has changed. Even a short acknowledgment helps. If you have follow-up questions, posting them early will leave the authors time to answer.
Thank you all for keeping the discussion constructive and timely.
Your AC