- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper tackles representation selection in medical causal modeling: deciding whether observed indicators should be retained as distinct variables or abstracted into latent clinical concepts. The proposed framework, LLCD, uses LLMs to derive candidate concepts, variable groupings, and causal tiers from metadata, learns latent representations via a missingness-aware variational model, and executes BIC-based graph search under tier constraints. Final representations and graphs are selected based on validation residual correlation and structural complexity. Experiments on ADNI, PPMI, and semi-synthetic benchmarks evaluate latent and graph recovery, SCM fitting, and interventional estimation. Although LLCD performs favorably, the distinct contributions of individual components and the sufficiency of the causal evaluation require further scrutiny.
Critical strengths
-
The investigated problem carries clear clinical relevance, and the proposed framework provides a coherent, end-to-end pipeline tailored to representation selection. In medical domains, clinical conditions are frequently manifested across multiple surrogate indicators; thus, optimizing the causal node space itself is both well-motivated and practically meaningful. Crucially, the authors recognize that raw BIC scores across non-identical variable spaces are not directly comparable, appropriately using validation structural goodness-of-fit to govern representation selection: a perspective that offers genuine methodological insight.
-
The empirical evaluation covers multiple complementary dimensions with encouraging initial results. Beyond indicator grouping, the paper assesses causal graph recovery and interventional effect estimation. Table 2 benchmarks against diverse latent causal discovery baselines, while Table 3 reports strong projected directed F1 scores of 0.873 and 0.981 on two semi-synthetic benchmarks. Methodological details such as subject-level data splits on real cohorts and reporting variance across five random seeds lend credible support to the framework's feasibility.
Critical weaknesses
-
Insufficient ablation of core contributions and baselines: Table 5 lacks a key ablation isolating the latent module from the tier prior (retaining latents without hierarchy). Crucially, the paper lacks two essential controls under identical candidate groupings: (1) a baseline that naively retains all candidate concepts, and (2) classical dimensionality reduction (PCA/Factor Analysis) with identical groupings and tier priors. Given that the latent-free baseline on ADNI already reaches a directed F1 of 0.835 (vs. 0.873 for the full model), controlled ablations are necessary to prove that gains stem from the selection criterion rather than grouping or directional priors. Additionally, the latent baselines in Table 2 should be carried over to Tables 3 and 4.
-
Potential intra-instance information leakage and constrained causal verification: In Eq. (14) and Appendix A.2.2, latent parents are inferred from indicator sets and then used to predict those same indicators. This risks target information leakage where high and low NLL merely reflect autoencoding/reconstruction artifacts rather than structural discovery: an issue that subject-level splits cannot resolve. Furthermore, quantitative causal evaluation is limited to two linear-Gaussian semi-synthetic benchmarks, with only one intervened variable per dataset and no reported variance, leaving the model's robustness to noisy tier priors or varied causal queries unverified.
Questions for authors
Q1. Evaluation protocol & target leakage (Appendix A.2.2 / Table 3): Does inferring the latent parent of a test indicator utilize itself from the same instance? If so, please provide results under a leave-one-out / target-masked inference protocol to eliminate circular reconstruction gains and ensure fair structural evaluation.
Q2. Controlled baselines for core contributions: Under identical groupings, representations, and search constraints, what is the performance gap between the proposed selection strategy and (1) naively retaining all candidate latents, or (2) classical PCA / Factor Analysis baselines? This is necessary to isolate the true value of representation selection and variational learning.
Q3. Sensitivity to noisy or absent priors: Please report the missing ablation in which latent modeling is kept, but tier priors are removed. Additionally, how robust is the framework to misspecified groupings or incorrect hierarchical constraints: can the data-driven stage reject invalid hypotheses?
Q4. Breadth and variance of interventional evaluation (Table 4): Please evaluate a broader spectrum of pre-specified intervention targets and strengths on the semi-synthetic systems, including error intervals across multiple seeds, to confirm that the reported interventional gains are consistent and not query-dependent.