- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies conformal calibration for contextual robust optimization with linear objective uncertainty. It first shows that minimizing worst-case regret over an uncertainty set defined by nominal regret recovers the original predict-then-optimize (PTO) decision under certain conditions. To enable decision refinement, the authors propose a reflected Fenchel–Young (FY) score, which decomposes into nominal regret, a reverse optimality gap, and a reflected stability gap. The paper establishes finite-sample marginal regret guarantees, characterizes when robust optimization changes the nominal decision, and develops a master–pricing algorithm. Experiments consider two-asset allocation, portfolio optimization, and solar-grid allocation.
Critical strengths
The self-centering result provides a useful characterization of exact-regret calibration. The two-asset allocation example clearly illustrates why minimizing worst-case regret over the nominal regret set cannot improve the PTO decision. The three-gap decomposition and the optimality conditions provide a mathematical explanation of when decision refinement is possible. The portfolio experiments also include global optimization certificates to assess the accuracy of the proposed algorithm.
Critical weaknesses
The motivation for decision refinement could be clearer. Theorem 1 establishes that exact-regret calibration retains PTO, but it is unclear why changing this decision is desirable in itself. A reduction in worst-case regret over the FY set does not necessarily imply an improvement over direct-regret calibration.
The tightness of the regret guarantee is not sufficiently examined. Conservatism can arise from three sources: conformal coverage exceeding ; the nonnegative reverse and reflected gaps in ; and the inequality . In the portfolio experiment, the calibrated threshold is larger the largest certified upper bound on worst-case regret. The contributions of these sources of slack remain unclear.
The practical interpretation of the guarantee could be better motivated. The guarantee controls regret relative to the hindsight optimum of the penalized objective, rather than portfolio losses or returns. It also does not imply improvement in mean regret or CVaR_95 relative to PTO, which are the main empirical performance metrics.
Questions for authors
The self-centering result shows that direct-regret calibration retains PTO, but this does not necessarily imply inferior decision performance. Could the authors provide stronger theoretical support for why reflected FY calibration should be preferred?
3 comments
Response to Reviewer F3eP (Part II)
W2: The tightness of the regret guarantee is not sufficiently examined. Conservatism can arise from three sources: conformal coverage exceeding ; the nonnegative reverse and reflected gaps in ; and the inequality . In the portfolio experiment, the calibrated threshold is larger the largest certified upper bound on worst-case regret. The contributions of these sources of slack remain unclear.
Response: The calibrated score threshold is a direct conformal bound, rather than the tightest regret certificate attainable from the FY uncertainty set. In fact, our manuscript already provides the sharper, decision-dependent certificate on the conformal coverage event (Corollary 2).
We further quantify the sources of slack in an added experiment (Table 3; Appendix B.3, Eq. (41)). In the main-text portfolio experiment (1,000 instances, , ), our diagnostic finds that the mean certified policy bound is 68.64% below the score threshold. The reverse and reflected gaps explain 97.14% of this tightening:
| Component | Share of tightening |
|---|---|
| Unused score budget | Negligible |
| Weighted reverse gap | 32.62% |
| Weighted reflected gap | 64.52% |
| Optimization gain (certified lower bound) | 2.86% |
Empirical score coverage is 89.3% against the 90% target, while the tightened regret certificate covers 95.0% of realized outcomes (Table 13, Appendix B.3).
W3: The practical interpretation of the guarantee could be better motivated. The guarantee controls regret relative to the hindsight optimum of the penalized objective, rather than portfolio losses or returns. It also does not imply improvement in mean regret or relative to PTO, which are the main empirical performance metrics.
Response: Our guarantee bounds realized shortfall from the modeled objective’s hindsight optimum, with finite-sample marginal coverage (Corollary 2).
The portfolio objective combines realized return with a quadratic penalty. The common hindsight benchmark gives
Thus, mean regret reductions equal absolute increases in the mean penalized objective value.
The conformal guarantee and comparative performance address different questions. The certificate does not guarantee lower mean regret or CVaR95 than PTO. Under linear objective uncertainty, PTO minimizes expected regret when predictions equal the conditional means, precluding universal strict improvement in both metrics. However, we focus on robust decision-making under prediction bias. Gains depend on prediction errors, decision structure, and the outcome distribution. Refinement improves expected regret when the benefit of correcting bias exceeds nominal opportunity cost (Eq. (22)); tail gains require analysis of the distribution (W1/Q1).
The portfolio experiment shows advantages in both mean and tail regret over PTO and the reported robust baselines (Table 1), while the real-data solar experiment demonstrates improved tail performance relative to PTO (Table 4).
I thank the authors for their response. My concerns have been addressed, and I will maintain my positive score.
Response to Reviewer F3eP (Part I)
We thank Reviewer F3eP for the positive assessment and constructive questions. We hope this response adequately addresses the reviewer's concerns, and we are more than happy to engage in further discussions.
Response: We agree that PTO is not necessarily inferior; indeed, it minimizes expected regret when the prediction equals the true conditional mean. However, our focus is robust decision-making under substantial uncertainty, where prediction bias and costly adverse outcomes motivate protection beyond nominal optimization, as extensively studied in the contextual robust optimization and decision risk assessment literature (Chenreddy et al., 2022; Sun et al., 2023; Zhou et al., 2026).
Theorem 1 identifies a structural limitation: direct-regret calibration necessarily retains PTO under the stated conditions, precluding further minimax-regret refinement. Our reflected FY construction addresses this limitation through decision-aware uncertainty calibration, enabling robust refinement that can improve decision quality when prediction bias undermines nominal decisions.
Theory and experiments also support the value of refinement. For a fixed context and a population uncertainty set with conditional coverage at least 1−α, Eq. (21), proved in Appendix A.2, shows that FY improves the population regret-quantile guarantee when its optimization gain exceeds the additional certification cost (Grob>Cλ). Examples 1–2 in Appendix A.5 give conditions for strict mean and tail improvement. In our portfolio experiment, historical training and tuning data are shifted relative to the common calibration and test distribution, preserving calibration/test exchangeability. FY reduces mean regret by 8.93% and CVaR95 by 5.51% (Table 1). The accompanying portfolio diagnostic links the mean gain to bias correction net of nominal opportunity cost (Eq. (22); Table 12, Appendix B.3).
References
Chenreddy, A. R., Bandi, N., & Delage, E. (2022). Data-Driven Conditional Robust Optimization. Advances in Neural Information Processing Systems, 35, 9525–9537.
Sun, C., Liu, L., & Li, X. (2023). Predict-then-Calibrate: A New Perspective of Robust Contextual LP. Advances in Neural Information Processing Systems, 36, 17713–17741.
Zhou, W., Orfanoudaki, A., & Zhu, S. (2026). Conformalized Decision Risk Assessment. International Conference on Learning Representations, 2026, 10581–10610.