- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper enhances DRO with a structural causal model (SCM). It constructs generative ambiguity sets in the exogenous space of a bijective SCM. Rather than perturbing the endogenous distribution directly, we independently parameterize the exogenous marginals and push their product distribution through the fixed structural map. Experiments verify the predicted structural properties and logical claim of this study.
Critical strengths
-
Well-motivated problem. Generative DRO does not guarantee structural compatibility, while SCOT is not trainable — both gaps are real, and bridging them is a worthwhile research direction.
-
Elegant parameterization. Placing the adversary in the exogenous space makes structural compatibility a byproduct of the construction rather than a constraint — this "by design" observation is tasteful in itself.
-
Direct empirical verification of the theory. The exact identity is verified numerically across 20 configurations, with an additional cross-check using an independent estimator.
Critical weaknesses
-
The core "theorem" is theoretically insufficient, and its impact on machine learning research needs to be articulated: how does this paper differ from "Designing Ambiguity Sets for Distributionally Robust Optimization Using Structural Causal Optimal Transport"?
-
There is a lack of discussion on optimization cost and scalability. Please provide the analysis on the complexity.
-
There is no sensitivity analysis to misspecification / estimation error of .
-
All methods' MSEs are compressed in the narrow band 0.090–0.103. The gaps between exoDRO and SCOT — ID 0.0904 vs 0.0906, mild 0.0916 vs 0.0917, moderate 0.0914 vs 0.0918 — fall in the range 0.0002–0.0004, which completely overlaps with the standard deviations across 5 seeds (±0.0002–0.0005). Claiming "the lowest across all evaluated settings" without any significance testing is not acceptable. Even the 1.7% relative improvement at strong OOD (0.0909 vs 0.0925) requires support from paired tests.
-
The experiments use only synthetic datasets, with no experiments on mainstream datasets. Please conduct experiments on datasets such as CIFAR.
-
The presentation of results throughout the paper is monotonous. The authors should follow "Designing Ambiguity Sets for Distributionally Robust Optimization Using Structural Causal Optimal Transport" and perform trajectory visualization experiments.
Questions for authors
-
Sensitivity to a misspecified / approximately invertible structural map. Your Theorem 1 relies on the structural map being a known bimeasurable bijection. When must instead be estimated from data and is only approximately invertible, what form does the exact KL decomposition degrade into? Can you characterize the order of magnitude of the resulting error term (e.g., in terms of the estimation error of or of its inverse), even approximately?
-
Statistical significance of the predictive results. Could you provide paired significance tests for exoDRO vs. SCOT across the evaluated settings — for example, a Wilcoxon signed-rank test across training seeds, or bootstrap confidence intervals for the mean MSE differences? Since the reported improvements over SCOT are small in absolute terms (e.g., vs. at the mild OOD level, against seed standard deviations of –), significance tests are needed to support the claim of being lowest across all settings.
-
Computational cost. What is the total training cost of exoDRO (wall-clock time and number of models) relative to the single-model GAS-DRO baseline?
-
Selected robustness budgets. Could you report the final robustness budgets selected for each method via the OOD-validation procedure — the Wasserstein radius for W-DRO, the KL radius for KL-DRO, the transport radius for SCOT, the ambiguity budget for GAS-DRO, and the coordinatewise budgets for exoDRO? Since these geometries are not directly comparable, knowing the operating points is important for interpreting the comparison.