- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper studies robust counterfactual explanations under the Rashomon effect when training labels are noisy. Building on ElliCE, which approximates the Rashomon set using a Hessian-defined ellipsoid, the authors show empirically that label noise can distort this uncertainty set by inducing a structured, low-rank perturbation that rotates its principal directions. To mitigate this, they propose a Homotopy Path-Following (HPF) method that interpolates between a label-agnostic conservative uncertainty set and the label-conditioned one using a scalar homotopy parameter. They further extend the construction to general quadratic uncertainty sets and show continuity of the robust counterfactual solution along the homotopy path. Experiments on five datasets, under symmetric and asymmetric synthetic label noise, compare HPF with ElliCE and other robust counterfactual baselines, and report improved robustness with competitive recourse cost and computational efficiency.
Critical strengths
-
The paper identifies an important failure mode of Rashomon-set-based robust counterfactual methods under label noise, where the uncertainty set itself can become distorted.
-
HPF provides a simple correction with theoretical continuity guarantees and is evaluated across five datasets and multiple baselines, showing strong robustness and competitive efficiency.
Critical weaknesses
-
The method is closely built on ElliCE, with the main addition being a scalar homotopy between a label-agnostic and label-conditioned uncertainty set. I find this extension somewhat incremental relative to the ICLR bar.
-
The proposed correction is motivated and validated for label-noise-induced geometric distortion. It remains unclear how much of the method’s benefit extends to other forms of uncertainty-set misspecification, which limits the broader robustness claims.
Questions for authors
-
How dependent is HPF on the specific low-rank geometric distortion induced by label noise? Would the method still provide robustness if the uncertainty set were misspecified by a qualitatively different shift, e.g., one that does not primarily rotate a few leading directions?
-
Have the authors evaluated the sensitivity of HPF to the homotopy parameter , e.g., by comparing performance across fixed values of ? Since t controls the trade-off between the label-agnostic and label-conditioned uncertainty sets, such an analysis would help clarify how much of the performance gain comes from the learned choice of t and how sensitive the method is to this choice.