- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper deals with incorporating a local geometry module for counterfactual generation. Authors provide an analysis of the faults of generating counterfactuals while only taking into account the boundary crossing of a classifier. Results showcase that adapting the generation to emphasize local geometry in the encoder space creates better supported counterfactuals. Authors also provide an analysis of different model combinations that showcases varying performance and validate all framework choices both experimentally and mathematically.
Critical strengths
Strengths:
- The geometry proposition is well-founded and addresses a real problem. The recognition that despite the samples crossing the decision boundary they might still be unrelated to the desired class is known and the proposed method seemingly addresses it.
- The paper is easily readable and proposes all required information in a good way. There is no bloat and each module has an explanation for why it earns it's place in the framework.
Critical weaknesses
Weaknesses:
-
Neural networks are not optimal and might be biased to information stemming from the dataset. Despite counterfactual research mainly dealing with classifiers and encoders, there is also a gap into criticizing the bias of the original models themselves. How can we be sure the geometry learned here is not searching for a geometric bias in the learned representation and instead looks at geometry? Is there an experiment that validates that such geometric topology, so to say, corresponds to real information?
-
There is no comparison with global geometry. There is a significant emphasis on the importance of the locality of the clusters, but there is no comparison with incorporating the distance or morphology between the clusters themselves. For example, incorporating global geometry, how clusters differ between themselves, might provide information about differences between them.
-
There is no comparison with prior work, all the results are different model combinations. There is no quantification of what the geometry module achieves due to the lack of baselines and the gap metrics are not particularly indicative of how well the model does. There are also no cross model ablations. While explanation is given for why these model combinations are chosen, the results are not reported and it is difficult to evaluate how dependent the performance is to the combination
-
It is also not clear apart from proposing the local geometry for counterfactuals if the authors have made an effort to adapt the geometry losses specifically for the counterfactual generation or if they propose changes. Most modules are relatively simple and already exist in some capacity in literature and the design is not substantially altered.
Questions for authors
Questions:
- Is there a comparison with global information that could better isolate the gain from incorporating local geometry?
- Are there comparisons with prior works that deal with similar problems? Are there results that could be reported by utilizing already established metrics, along with the proposed ones? The proposed metrics being only evaluated on the baseline and not on prior works makes the comparison difficult as is.
- Could you provide the results of different model combinations, so that the performance difference can be gauged numerically?
5 comments
Followup on Rebuttal
We thank the reviewer again for their feedback. We have revised the paper based on their comments and those of the other reviewers, as summarized here (summary of revisions comment). We would appreciate hearing whether our responses address their concerns and would be happy to clarify any remaining ones.
Reply to rebuttal
Thank you to the authors for the rebuttal. While the new experiments shed some more light on how the methodology performs, I feel that the answer to W4 confirms that the contribution is the analysis of the paper and not a new module. Also, in the answer to W3 the baseline is already better than the rest of the methodologies on Supp-Suc, the one metric where the framework ranks first. Why is the framework behind prior methods on the other metrics, and could the authors clarify what is the overall value of the module is?
We thank the reviewer for finding the geometry module well-motivated and the framework clear. We clarify each concern below.
W1: Does the geometry capture real information in the data?
Yes. Encoders can carry bias, so we test the geometry against two sources of truth independent of the encoder:
W2, Q1: Comparison with global geometry
To test whether global geometry adds information, we added global features (e.g., class-center distance and overlap, Figure 9). Local geometry adds more predictive value: it raises R2 by 0.10 over boundary + global, while global features add only 0.02 over local geometry.
W3, Q2: Comparison with prior work, using established metrics
Our method achieves the highest Supp-Suc and beats DiCE and REVISE on distance, LOF, and IM1. DiCE flips more often, and FACE and retrieval score better on LOF [4] and IM1 [5] but succeed less and move much farther (Figure 5). We compare with DiCE [1], FACE [2], REVISE [3], and retrieval on all six datasets, on the same frozen embeddings, 12 models, and starting points. Running all methods in embedding space is the most direct comparison of search strategies on our task, though not the native setting of DiCE, FACE, and REVISE. To check this choice, we also run DiCE and FACE natively on Papalexi gene expression and score their encoded outputs with the same classifier and metrics (ours keeps higher Supp-Suc and r; Appendix C.4). Such native runs are possible only for some datasets, because these methods are tied to a specific input type, whereas ours applies to any encoder. LOF and IM1 do not depend on our support definition. Norm. CF-Dist divides distance by the encoder's RMS spread. Lower is better for all three.
W3, Q3: Results for each model combination
We read this as asking for (i) absolute results per model rather than gaps, (ii) the effect of the geometry module on each model, and (iii) whether the conclusions depend on which pairs are selected.
(i, iii) How much does performance depend on the combination? Within each pair, accuracy differs by at most 0.03, while baseline CF-Suc differs by 0.10 to 0.65 and Supp-Suc by 0.09 to 0.57. Pairs were chosen by validation accuracy, before computing any counterfactuals.
(ii) What does the geometry module achieve? It improves or preserves both metrics for all 12 models, most where baseline search fails most (e.g., MNIST ViT). Per-model values (Appendix C.3):
W4: Is the geometry adapted to counterfactual generation?
Each component is designed for counterfactual search in learned representations. The support loss (Eqs. 11, 24) recomputes target-class neighbors at every step, keeping the search near observed target-class data. The curvature-based step size (Eq. 25) shrinks updates where the representation is less linear. Table 2 shows each component contributes. Our contribution is how these measures are combined and used: together, they diagnose why similarly accurate models differ in counterfactual behavior and improve counterfactual search. To our knowledge, no prior work has combined them in this way, and we benchmark the framework against established methods across six datasets spanning diverse modalities.
[1] Mothilal et al. 2020. [2] Poyiadzi et al. 2020. [3] Joshi et al. 2019. [4] Breunig et al. 2000. [5] Van Looveren & Klaise 2021.