- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CUB-RO, a nonparametric method for constructing contextual uncertainty sets for robust optimization. It selects historical scenarios with similar contexts and places a ball around each one to form an uncertainty set. The authors analyze set approximation and decision quality and evaluate the method on newsvendor, portfolio optimization, and unit commitment tasks.
Critical strengths
The proposed construction aims to reduce excessive conservatism and induce more effective downstream decisions, with encouraging results on the evaluated benchmarks.
Critical weaknesses
However, nearest-neighbor selection and unions of local neighborhoods are established ideas. The methodological novelty of combining these ingredients for decision problems appears limited.
Questions for authors
- In Eq. (5), each local radius is proportional to the distance to the nearest other selected scenario. A rare, isolated scenario can therefore receive a very large radius, potentially allowing many extreme scenarios into the prediction set and leading to conservative decisions. What justifies this radius rule, and how sensitive is performance to isolated centers?
- Section 5.2 should clarify what the target set C(s) should represent for different task objectives, such as minimizing mean loss or CVaR. How do the upper bounds on worst-case costs and decision suboptimality over C(s) relate directly to these objectives?
- The parameter-selection procedures need further justification. In the newsvendor experiment, mean loss is the primary metric and CUB-RO achieves the lowest test mean loss, yet K and \beta are selected by minimizing validation CVaR_{80} subject to a mean-loss constraint. Why use this criterion, and would tuning directly for mean loss change the conclusions? For SCUC, how were the fixed values K = 10 and \beta = 0.05 determined?
2 comments
Thank you for your detailed responses. I have reviewed the additional radius sensitivity and parameter-selection experiments. I will maintain my score.
Thank you for the questions about the contribution, radius rule, and evaluation objectives. We clarify these design choices and report additional radius and tuning controls.
W1. Methodological contribution. We will make clearer how the established ingredients serve the decision problem addressed here. A region fitted to context-relevant observations can still admit costly adverse directions weakly supported by those observations. CUB-RO uses retrieved complete trajectories as anchors and spacing-based local neighborhoods to control the adversarial domain before optimization, without adding context-matching constraints to the AP.
SRO-SI weights neighborhood-wise worst costs to form an average; CUB-RO uses context to select and shape the set for a single worst-case recourse objective. The analysis connects directional boundaries to worst-case costs and separates representation and search errors in the decision bounds. This contextual representation and its decision analysis form our contribution.
The same-center Portfolio comparison isolates expansion: VaR/CVaR decrease by 10.63%/12.92%, with paired CVaR difference -0.2249 percentage points (95% interval [-0.2774, -0.1707]). This provides controlled evidence for the construction on that task.
Q1. Radius rule and isolated centers. Your question identifies the trade-off captured by Proposition 3. Nearest-center spacing supplies a local scale: dense groups receive smaller neighborhoods and isolated centers larger ones, with a common multiplier controlling expansion. Larger radii can reduce missing uncertainty while introducing additional uncertainty. The consistency theorem requires the largest physical radius to vanish.
To examine sensitivity directly, we fixed K, the multiplier, and all centers in the 23 Newsvendor folds. For each query, we capped only the most isolated center's radius at the median radius or set it to zero, retaining the center. Neither intervention was tuned on test outcomes. On the same 92 decisions:
Both interventions change 32/92 decisions; maximum changes are 115.84/118.88 demand units. The lower observed mean losses show that moderating an isolated radius can improve this benchmark. We will include this sensitivity and explain the spacing rule as a local-scale choice whose behavior should be checked for isolated centers. In saved SCUC runs, the median within-day maximum-to-median radius ratio is 1.62, with maximum 2.10; these describe radius heterogeneity rather than a controlled outlier intervention.
Q2. Target set and evaluation objectives. We will clarify the two roles. In Section 5.2, C(s) is the target scenario set for robust decision quality; the consistency theorem takes it to be the true conditional support. For a fixed decision, let HC(x,s)=supz∈C(s)Q(x,z). If the conditional distribution is supported on C(s), then
\le H_C(x,s)\le H_U(x,s)+\varepsilon_{\rm miss}(s).$$ Adding first-stage cost gives total-cost bounds. The decision-gap guarantee compares with the robust optimum over C(s); mean loss and CVaR evaluate the resulting decisions empirically. A mean/CVaR regret guarantee would require comparison with the corresponding distributional optimum. We will make these roles explicit in Section 5.2. **Q3. Parameter selection.** Newsvendor's validation CVaR80 criterion balances tail performance with a mean-loss requirement of at most 5% above SAA. Each 52-week window uses 36 observations for fitting and 16 for validation, then refits the selected configuration on all 52. CVaR80 uses an upper-tail mass of 3.2 validation observations, versus 0.8 for CVaR95. If no candidate met the mean constraint, we selected the lowest-CVaR80 candidate from the full grid. This occurred in 1/23 windows; we will specify this fallback in Appendix B.2. Following your suggestion, we also selected directly by validation mean, keeping the split, grid, refitting, and held-out cases fixed, with ties broken by CVaR80 then VaR80. Mean/VaR95/CVaR95 become 86.04/231.60/430.33, versus 85.84/231.60/430.67 originally. The paired mean difference is 0.204 [-0.168, 0.803] (95% four-fold-block interval), indicating similar test performance. The separate same-neighborhood zero-radius control gives mean 85.05. We will report these controls to distinguish the tuning objective, neighborhood selection, and expansion. For SCUC, K=10 and beta=0.05 were fixed without tuning or a specific selection criterion. Figure 5(c) reports sensitivity on four preselected held-out days, including lower-cost settings.