- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of bivariate causal discovery, that is, given two correlated variables, identifying cause and effect. For this, the authors assume an additive-noise model but allow a distribution shift between environments. This is an additive mean shift to one noise variable, while preserving the structural mechanism. The statistical asymmetries obtained from this shift can provide additional evidence for differentiating cause from effect. The method comes with identifiability guarantees and has been extensively evaluated on synthetic and real-world datasets.
Critical strengths
The paper is a great extension of the theory for cause-effect inference from bivariate data under an additive-noise assumption to scenarios with distribution shifts in noise variables. This can provide additional statistical evidence for inferring the causal direction. Beyond the theoretical analysis, the empirical results look promising.
Critical weaknesses
The identifiability result appears to require stronger assumptions to exclude shifts that preserve the effect distribution. For example, with a symmetric U-shaped relationship, moving a symmetric bell-shaped cause distribution could leave the effect distribution unchanged. This can happen through a mean shift alone, without changing the cause's variance and, thus, both causal directions would then receive the same zero score (not identifiable).
Questions for authors
Overall a great extension of the ANM-based approach! Just a few questions:
- I might be overlooking something, but, as mentioned above, there seem to be conditions where the proposed score cannot identify the causal direction, for example, a symmetric U-shaped relationship where shifting the cause leaves the effect distribution unchanged. An additional assumption may be needed here. What could that look like and how would the identification result need to be revised (if at all)?
- What regression models are used for computing KRD's residuals and for the baseline methods, I am assuming you are using causal discovery library where these are implemented, if yes, which one? Appendix B.1 describes the baseline implementations, but I could not find the corresponding details for KRD itself. It would be insightful to see the implementation and configuration used for the experiments.
Otherwise, if the first question can be addressed, I don't have any further concerns as the theoretical guarantees are then clearly given.
2 comments
Thank you for the clarification, in particular of my first question (which was my main concern). I keep my recommendation for acceptance!
Response to Reviewer kepW
We thank the reviewer for recognizing our extension of additive-noise causal discovery to two environments using a simple residual displacement score. We also appreciate the time and thoughtful feedback devoted to our work. Please see our uploaded revision with changes highlighted in blue.
Response to weaknesses:
We thank the reviewer for this example. The stronger condition excludes the degenerate scenarios in Remark 1, which we may not have stated clearly enough. We have revised it (lines 200–240) to give precise distributional definitions and an exhaustive classification of the invariance cases. In our revised classification, the U-shaped example falls under (a) cause-shift masking, where the cause shifts but the effect distribution remains unchanged.
Response to questions:
As noted above, Remark 1 (revised lines 200–240) specifies the degenerate scenarios excluded by the identification result, including this U-shaped example.
Both KRD variants use our implementation of ridge regression with 64 random Fourier features, an intercept, and a linear term, f(x)=β0+β1z(x)+∑j=164wjϕj(x), where x is the regression input, z(x) is its IC-standardized value, and ϕj(x) are random Fourier features. We have added the implementation and configuration details to Appendix B.1, “Regression implementation in KRD” (lines 1163–1191).
Our baseline implementations use established Python libraries, including scikit-learn for regression, ITE in Python for entropy estimation, CDT for IGCI, sparse_shift for MSS, causaldag for UT-IGSP, and causal-learn for CD-NOD. Moreover, we have validated our ANM and IGCI implementations against the benchmark of Mooij et al. (2016).
We thank the reviewer again for recognizing the value of our approach and for the suggestions that helped us make our analysis more rigorous.
Reference:
Joris M. Mooij, Jonas Peters, Dominik Janzing, Jakob Zscheischler, and Bernhard Schölkopf. Distinguishing cause from effect using observational data: methods and benchmarks. Journal of Machine Learning Research, 17(32):1–102, 2016.