- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper addresses the problem of causal discovery by assuming that a functional causal model follows the form of a location-scale noise model. Here, the authors extend the existing theory by allowing hidden variables, including confounders and hidden intermediates, whose effects enter through the location and scale of an effective noise term. For this setting, conditional identifiability results are given. The method has been evaluated on synthetic datasets.
Critical strengths
The paper aims to nicely extend the location-scale noise model to exploit asymmetries between cause and effect for causal discovery with hidden variables. This is a promising extension and contribution, although there are some issues (see below).
Critical weaknesses
There are two core issues:
- The paper’s correctness argument assumes that relevant candidate parents have already been collected, without showing that the algorithm has collected them. Restricting the setting to just two observed variables could simplify this, but correctness of the resulting bivariate procedure would still need a separate justification.
- The experimental evaluation is not sufficiently broad for this kind of work. I would expect comparisons across a wider range of datasets and, in particular, real-world datasets. Further, the paper builds on prior work on location-scale noise models but does not compare with those methods in the experiments.
Questions for authors
The extension of location-scale noise models to hidden-variable settings is a promising direction. However, there are currently too many unresolved issues with this paper:
- The correctness argument requires that the algorithm has collected the relevant candidate parents in non-bivariate causal discovery settings. Where would this information come from? The paper might be better positioned if it focused on the bivariate case, where this particular issue is simpler and which is also the setting of the prior work.
- Even for bivariate cases, you establish (important) identifiability conditionally on Assumptions 2 and 3 (Residual irreducibility), but it remains unclear which concrete bivariate model families would satisfy these assumptions. An explicit characterization or sufficient conditions would strengthen the result here.
- The experimental evaluation is not sufficiently broad for this work. In particular, since you extend location-scale noise models, why is there no direct comparison with the related work in the experiments (or did I miss it)? While they might not be applicable to graph discovery, you can at least compare with them in a bivariate setting. In this regard, you can check the Tübingen cause-effect pairs dataset for the bivariate case, which would help to clarify how it compares with causally sufficient alternatives. Or is there a particular reason for not including it?