- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors have presented a continuous-time causal latent variable model designed for counterfactual analysis of high-dimensional longitudinal data. This approach, CLL-NODE, parameterizes latent dynamics using Neural ODEs conditioned on treatment assignments and auxiliary covariates, and incorporates an adversarial regularization term to encourage treatment-invariant initial latent states. The authors evaluated the model on Causal MNIST, the Physionet ICU dataset, and a semi-synthetic variant where treatment effects follow a predefined ODE. Performance was assessed using a proxy metric based on the classification error difference of an oracle Transformer applied to factual versus counterfactual trajectories, alongside standard reconstruction and prediction metrics. The authors claim state-of-the-art counterfactual quality and improved causal identifiability.
Critical strengths
- The authors have approached a critical gap in the literature. While a consistent suite of efforts such as G-Transformer has been presented for the continuous domain, continuous time-setting has been an oft ignored setup. This extension of deep causal latent variable modeling to continuous-time settings via Neural ODEs is well-motivated and addresses a meaningful gap in longitudinal causal inference.
- The paper was well motivated and easy to read and comprehend. The paper reports two strong empirical results on established benchmarks that demonstrate competitive counterfactual generation and temporal interpolation/extrapolation capabilities.
- Finally, the integration of adversarial regularization to decouple initial latent states from treatment assignment is a thoughtful design choice that aligns with standard causal identifiability assumptions.
Critical weaknesses
There are a few aspects in the paper that might need some deliberation
- The proxy evaluation metric lacks theoretical grounding and may not reliably correlate with true counterfactual fidelity. This metric seems to essentially measures how well the model fools a downstream predictor rather than causal correctness.
- The semi-synthetic evaluation was appreciated but could have had a stronger impact if instead of a hand-crafted ODE for treatment effects it was constructed/presented using ground-truth causal graphs. This would have improved the ability to validate whether the model actually recovers the underlying causal structure or merely fits the imposed dynamics.
- The authors didn't report key practical concerns such as computational complexity and training stability, especially considering Neural ODE-based architectures with adversarial components potentially applied to high-dimensional, irregularly sampled clinical data.
- Finally, the theoretical claims regarding improved identifiability from the adversarial component are asserted without formal proofs, and the experimental design lacks rigorous ablation studies to isolate the contribution of the adversarial term versus the Neural ODE dynamics.
Questions for authors
-
How does the adversarial regularization interact with the reconstruction and prior terms in the ELBO? Were there empirical or theoretical mechanisms are in place to prevent mode collapse or posterior collapse during training? Have you observed degenerate latent solutions or training instability across different random seeds?
-
The proxy counterfactual quality metric relies on a Transformer classifier’s error difference. Can you justify why this metric correlates with true counterfactual accuracy, or provide alternative evaluations such as intervention consistency checks, sensitivity analyses, or ground-truth counterfactuals on fully synthetic causal graphs?
2 comments
-
Counterfactual identification and the adversarial component.
We thank the reviewer for highlighting this important distinction. We agree that identification has a precise technical meaning in causal inference and that our original formulation did not adequately distinguish counterfactual identification from improvements in counterfactual prediction.
Our intended claim is that the adversarial component improves counterfactual prediction by encouraging the inferred initial latent state to contain less treatment-specific information. This objective is theoretically motivated by Lemma 1, which provides support for the proposed treatment-invariance regularization. However, we acknowledge that reducing treatment information in does not, by itself, guarantee counterfactual identifiability or the correctness of individual counterfactual predictions. To address this concern, we have revised the wording of contribution (ii) and the conclusions to clarify the scope of our claims.
We would also like to emphasize that the manuscript includes an ablation study examining the contribution of adversarial regularization. Specifically, we compare the full CLL-NODE model with Causal-NODE, a latent neural ODE model without the adversarial component. In addition, Figure 4 illustrates the effect of the discriminator on the learned latent representations. Together, these results provide empirical evidence supporting the contribution of adversarial regularization to counterfactual prediction performance.
Table. Counterfactual prediction MSEs on semi-synthetic PhysioNet with covariate-dependent treatment assignment. Lower values are better.
| Method | MSE |
|---|---|
| CLL-NODE | 1.483 ± 0.05 |
| Causal-LNODE | 3.489 ± 0.1 |
| VCI | 4.7 ± 1.0 |
| CEVAE | 1.454 ± 0.02 |
In addition, in the revised pdf we also changed Figure 1 and included ablations regarding the observation sparsity and extrapolation. The revised text is marked with blue.
References
[1] Monteiro, M., De Sousa Ribeiro, F., Pawlowski, N., Castro, D. C., and Glocker, B. (2023). *Measuring Axiomatic Soundness of Counterfactual Image Models.
[2] De Sousa Ribeiro, F., Santhirasekaram, A., and Glocker, B. (2025). *Counterfactual Identifiability via Dynamic Optimal Transport.
We thank the reviewer for their careful evaluation of our manuscript and for the constructive comments and suggestions. We address each point below.
Counterfactual evaluation metric.
We agree that there is no formal mathematical guarantee that the proposed evaluation metric correlates with the true counterfactual prediction error. The metric we employ is related to counterfactual effectiveness, extensively discussed by Monteiro et al. (2023) [1]. Our evaluation procedure, which employs an oracle predictor, follows De Sousa Ribeiro et al. (2025) [2].
Counterfactual effectiveness assesses whether generated counterfactual outcomes reflect the intended intervention. Specifically, if the generated counterfactual trajectories adequately capture the characteristics associated with the target treatment T′, the oracle classifier should recognize them as belonging to that treatment group with an accuracy comparable to its accuracy on real observations from the corresponding group.
However, as discussed by De Sousa Ribeiro et al. (2025) [2], counterfactual effectiveness serves as a diagnostic measure of counterfactual soundness rather than a guarantee of counterfactual identifiability or causal validity. We therefore acknowledge that this metric provides only indirect evidence of counterfactual quality.
To complement this evaluation, we also conducted experiments on a semi-synthetic PhysioNet dataset, where ground-truth counterfactual trajectories are available and counterfactual prediction errors can be computed directly. We have incorporated the corresponding references and a more detailed discussion of the evaluation methodology into the revised manuscript.
Semi-synthetic evaluation.
The ODE-based treatment effect was introduced to account for the longitudinal nature of the PhysioNet data. Specifically, modeling the treatment effect through a differential equation allows us to represent its continuous-time evolution and capture how treatment-induced changes in physiological measurements develop over time. This construction is intended to provide a more appropriate semi-synthetic evaluation setting for time-series counterfactual prediction. The results reported in the original submission correspond to a setting in which both covariates and treatment influence the observed outcomes, while treatment assignment is independent of the covariates. In the revised manuscript, we additionally consider a setting with covariate-dependent treatment assignment, which directly follows our causal graph in Figure 2. The corresponding results are presented in the table below, demonstrating that our method achieves performance comparable to that of CEVAE.
Training stability and the ELBO objective.
We did not observe training instabilities when employing the proposed multiple-shooting formulation. In contrast, training the model on complete trajectories without multiple shooting did not converge successfully. This issue is discussed in Appendix F, where we investigate the influence of shooting variables on model training and performance.
Regarding the interaction between the ELBO objective and other model components, we did not introduce additional mechanisms specifically designed to prevent mode collapse or posterior collapse, as the proposed model exhibited stable training behavior without such interventions. Nevertheless, we carefully selected the hyperparameter λ, which controls the contribution of the ELBO term to the overall training objective, for each dataset, as described in Equation (5).
Furthermore, the relatively small standard deviations reported across experimental runs provide empirical evidence of the robustness of our results to different random seeds.