- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates local causal discovery in the presence of both directed cycles and latent variables, and proposes a constraint-based method called LoCL. The authors first establish a graphical characterization of the Markov blanket and theoretical connections between local and global causal structures. Based on these results, they develop a local discovery algorithm that progressively expands the search region to recover the causal structure surrounding a target variable, with theoretical guarantees of soundness and completeness. Experiments on random cyclic graphs and the DREAM4 gene regulatory network demonstrate promising structural recovery accuracy and computational efficiency.
Critical strengths
1.The paper addresses local causal discovery in the simultaneous presence of directed cycles and latent variables, relaxing important structural assumptions made by most existing local methods. This makes the problem theoretically meaningful.
2.The paper establishes theoretical consistency between local and global causal structures and develops a local learning algorithm with theoretical guarantees. The ability to reduce computational costs while preserving identifiable causal information is a meaningful contribution.
Critical weaknesses
1.The paper does not include MMB-by-MMB (Xie et al., 2024)[1], a relevant local causal discovery method that considers latent variables. Including this baseline would provide a more comprehensive evaluation of LoCL against existing local causal discovery approaches.
2.Although the paper reports several quantitative metrics, it does not provide a direct visualization of the local causal structures recovered by LoCL on the experimental datasets. Such visualizations, together with the corresponding ground-truth structures, would help readers better understand the learned causal relationships and assess the reliability of the proposed method.
Reference:
[1] Local causal structure learning in the presence of latent variables. ICML24
Questions for authors
1.Why is MMB-by-MMB not included in the experimental comparisons? Could the authors clarify this omission and consider including it as an additional baseline?
2.Could the authors provide visual comparisons between the local causal structures recovered by LoCL and the corresponding ground-truth structures? This would help illustrate the method's ability to recover causal relationships beyond the reported quantitative metrics.
3.I noticed that your method can handle both circles and latent variables. Could the authors clarify the practical applications of handling circles and explain what real-world problems this capability can address?
5 comments
Response to Reviewer G48n - Part 2
Q2. Although the paper reports several quantitative metrics, it does not provide a direct visualization of the local causal structures recovered by LoCL on the experimental datasets. Such visualizations, together with the corresponding ground-truth structures, would help readers better understand the learned causal relationships and assess the reliability of the proposed method. Could the authors provide visual comparisons between the local causal structures recovered by LoCL and the corresponding ground-truth structures? This would help illustrate the method's ability to recover causal relationships beyond the reported quantitative metrics.
A2. Thank you for your helpful suggestion. To provide a more intuitive illustration of LoCL's structural recovery performance, we present two examples from the DREAM4 dataset, comparing the ground-truth σ-PAGs with the corresponding local structures recovered by LoCL around targets G88 and G70. The corresponding target-adjacent edges are aligned below for comparison.
| Ground Truth | LoCL |
|---|---|
| G85 G88 | G85 G88 |
| G62 G88 | No edge |
| G44 G88 | G44 G88 |
| G37 G88 | No edge |
| G10 G88 | G10 G88 |
| Ground Truth | LoCL |
|---|---|
| G37 G70 | G37 G70 |
| G28 G70 | G28 G70 |
As shown above, LoCL perfectly recovers the local structure around G70. For G88, LoCL correctly recovers two bidirected edges but misses the edges between G88 and G62 and between G88 and G37. It also incorrectly orients the circle endpoint at G85 as an arrowhead. We will include these visualizations in the revised manuscript.
Q3. I noticed that your method can handle both circles and latent variables. Could the authors clarify the practical applications of handling circles and explain what real-world problems this capability can address?
A3. Thank you for this insightful question. Handling causal cycles is particularly important for real-world systems involving feedback mechanisms. For example, Mooij and Heskes (2013) demonstrated the practical relevance of cyclic causal discovery by reconstructing a cellular signaling network from real-world flow cytometry data, revealing evidence of feedback loops. Similarly, feedback mechanisms are widely recognized in gene regulatory networks (Rohbeck et al., 2024) and neural systems (Sanchez-Romero et al., 2019).
In such systems, conventional acyclicity assumptions may exclude important causal relationships. Handling cycles therefore extends the applicability of causal discovery to complex systems with feedback (Forré and Mooij, 2018; Mooij and Claassen, 2020), enabling a more faithful representation of causal relationships and providing a foundation for subsequent causal reasoning and intervention analysis (Forré and Mooij, 2020). We will include this discussion in the revised manuscript.
References:
- Joris M. Mooij and Tom Heskes. Cyclic causal discovery from continuous equilibrium data. UAI, 2013.
- Martin Rohbeck, Brian Clarke, Katharina Mikulik, Alexandra Pettet, Oliver Stegle, and Kai Ueltzhöffer. Bicycle: Intervention-based causal discovery with cycles. CLeaR, 2024.
- Ruben Sanchez-Romero, Joseph D. Ramsey, Kun Zhang, Madelyn R. K. Glymour, Biwei Huang, and Clark Glymour. Estimating feedforward and feedback effective connections from fMRI time series: Assessments of statistical methods. Network Neuroscience, 2019.
- Patrick Forré and Joris M. Mooij. Constraint-based causal discovery for non-linear structural causal models with cycles and latent confounders. UAI, 2018.
- Joris M. Mooij and Tom Claassen. Constraint-based causal discovery using partial ancestral graphs in the presence of cycles. UAI, 2020.
- Patrick Forré and Joris M. Mooij. Causal calculus in the presence of cycles, latent confounders and selection bias. UAI, 2020.
Thank you
Dear Reviewer G48n,
We thank you once again for your time and efforts. Since the discussion period will end in 2 days, we were wondering whether our response has addressed your concerns. If you have any additional comments, please let us know, we would be happy to address them.
Thanks a lot,
The authors
Response to Reviewer G48n - Part 1
We are grateful for your constructive comments and for recognizing the significance of handling directed cycles and latent variables, the theoretical consistency between local and global causal structures, and the ability to reduce computational costs while preserving identifiable causal information. We hope the responses below clarify the points raised.
A1. Thank you for your valuable suggestion. Following your suggestion, we have included MMB-by-MMB as an additional baseline in our experiments. We would also like to note that our original experiments included LatentLCD, a recent local method that accounts for latent variables.
The comparison results under the original settings are summarized in Table R10 below. LoCL consistently outperforms MMB-by-MMB across all settings, further demonstrating its effectiveness and efficiency in the presence of cycles and latent variables.
We have also conducted an additional comparison in an acyclic setting using the real-world ANDES network with 223 nodes, 8 latent variables, and a sample size of 1,000. As shown in the last two rows of Table R10, LoCL achieves slightly higher structural accuracy than MMB-by-MMB while incurring lower computational costs. We will incorporate these additional results into the revised manuscript.
Table R10. Additional baseline.