- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes separating high-dimensional counterfactual generation into an additive latent SCM and a conditional image generator. Counterfactual inference preserves abducted latent residuals, propagates interventions through the latent graph and estimates the final state using conditional flow matching. The paper provides conditional identification and generalisation results with experiments on Morpho-MNIST and OASIS MRI.
Critical strengths
-
The separation between causal estimation and image synthesis provides a clear modular framework. Explicitly distinguishing structural residuals from rendering noise helps clarify which variation should persist across counterfactual worlds. Moreover, the paper carefully acknowledges its assumptions and limitations, including representation validity, overlap, the model dependence of fixed-noise pairing, and the illustrative status of the OASIS causal graph.
-
On the empirical front, the known-SCM experiment includes a useful evaluation before image generation. For example, in Table 2, preserving intensity residuals improves counterfactual intensity NRMSE from 0.384 to 0.114, indicating strong performance gains. The ablations also demonstrate the importance of structural propagation and residual preservation.
Critical weaknesses
-
An existing paper (Peng et al., Latent Causal Modeling for 3D Brain MRI Counterfactuals) already encodes images, fits a latent structural mechanism, abducts and preserves its residual, propagates counterfactual parents, and decodes the resulting latent into an image. This substantially overlaps with the proposed separation of causal propagation from image synthesis. Although this paper (the one under review) adds some additional flexibility, it does not clearly establish what differences constitute the main advance nor does it demonstrate its benefit through a controlled comparison. This is particularly important because the factorisation itself is presented as the central contribution.
-
Another, more specific, weakness is that the experimental evidence is insufficient to establish the benefit of the proposed separation between latent causal propagation and image generation. On Morpho-MNIST, the residual-preservation experiment demonstrates the importance of retaining unit-specific information, but does not establish an advantage over existing residual-preserving latent SCMs. Although the paper includes a common-bottleneck ablation, its replacement architecture is insufficiently specified to isolate the contribution of the factorisation from differences in model capacity or optimisation. A controlled comparison using the same image generator and comparable structural-model capacity would strengthen this claim. In addition, the OASIS experiments lack quantitative baseline comparisons and measurements of subject preservation, limiting evidence of practical improvement. All analyses could be improved with the inclusion of uncertainty estimates across independent training runs, which would make the robustness of the reported gains easier to assess.
Questions for authors
- What is the methodological advance over Peng et al.’s latent residual-preserving SCM followed by image decoding?
- Which experiments resample rendering noise, reuse a sampled seed, or reuse factually inverted noise?
- Which counterfactual estimand does each protocol evaluate?
- How are nonterminal encoders constrained, and how are predicted latent states converted back into scalar attributes for Table 2?
- Are OASIS experiments split by subject across all slices and visits, and what precisely replaces the common bottleneck in the ablation?
Response to Reviewer 3
W1/Q1 (Peng et al.). We will cite and discuss Peng et al. in the main text. It is the closest prior instance of "encode, fit a latent mechanism, preserve the residual, propagate, decode", and we do not claim that pipeline is new. The differences:
Controlled comparison. Peng et al.'s structural component is a residual-preserving linear latent SCM. Keeping our frozen encoder and generator and refitting only a linear SCM, the Morpho-MNIST effectiveness MAE worsens: do(thickness) 0.23→0.32, do(intensity) 6.4→9.3, do(slant) 3.0→5.2, and the propagated intensity after do(thickness) 6.0→10.1. Reconstruction (0.0086) and reversibility are unchanged, so the gain comes from the structural mechanism. On OASIS, fresh ϵ changes an image by only 5.6×10−4 (brain-masked L1); counterfactual content is carried by hK.
W2 (evidence). The linear variant and the inference-time ablations (no propagation, no residual) share the encoder and generator, isolating the structural model; the linear variant is itself a residual-preserving latent SCM, complementing Table 2 (RMSE 18.558→5.561). On OASIS, the null intervention leaves hK unchanged (≤1.3×10−3), removing the residual lowers subject re-identification of held-out reconstructions from 0.82 to 0.41, and noise-floor and spectral analyses (R1 W2) rule out generation variability. All results are single-run, which we will state.
Q2 (noise). All paper experiments resample ϵ freshly ("Noise type in inference", appendix); none reuse a seed or inverted noise, which we will state in the captions. Morpho-MNIST L1 for fixed / fresh / inverted noise: reconstruction 0.0086/0.0085/0.0085; reversibility do(thickness) 0.032/0.031/0.034, do(intensity) 0.012/0.011/0.017, do(slant) 0.013/0.012/0.018, do(digit) 0.027/0.027/0.032. Conclusions do not depend on the convention and lie above the fresh-noise floor (0.0059); on OASIS the three agree to three decimals.
Q3 (estimands). All protocols evaluate, via samples, the fresh-noise counterfactual law P(Xa∣h=hobs) of Theorem 1. Effectiveness compares generated attributes with targets; reversibility and null intervention are consistency checks, not paired individual estimates; Table 2 evaluates the latent descendant before generation. The fixed-noise pairing is not identified (Sec. 3.4) and serves only as a robustness check. We will add an estimand table.
Q4 (encoders, Table 2). Each non-terminal node uses one linear layer into the latent space; EK is trained with flow matching and frozen, anchoring the scale, and the rest is fit with LSCM. Latents do not collapse: the effective rank of hK is 30/128 on Morpho-MNIST (22 for a random encoder) and 178/384 on OASIS (50), with no dead dimensions. Linear probes recover the attributes from mK(pa) (digit acc. 0.999; R2≥0.98) but hardly from UK (0.28; R2≤0.26). For Table 2, PCA is fit jointly on predicted and true counterfactual latents and both are projected onto PC1; RMSE is in PC1 units, the same affine map applies to both, so NRMSE is the interpretable number.
Q5 (split, ablation). The OASIS split is by session, stratified by clinical group: 299 sessions (6,279 slices) for training, 74 (1,554) for evaluation; all slices of a session stay together, but other visits of an evaluation subject may be in training, so we will call these held-out sessions, not unseen subjects. Ablation: the 128-d CLS state hK is replaced by 49 patch tokens (7×7, 128-d each) predicted from the parents by a shared terminal decoder, giving 6272 terminal coordinates and reintroducing the dimensional gap; parameter counts match. We will specify this in the appendix.