- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper applies the prior-fitted-networks, a popular amortized foundational model, to the problem of predicting longitudinal potential outcome under a sequence of interventions. The network takes the historical dataset as input, and predict the CID of all the variables in the future. Results on synthetic and semi-synthetic datasets are promising.
Critical strengths
-
This paper tackles an important problem. The architecture is sound in that it uses mask mechanism to ensure the correct information flow.
-
Unlike previous PFNs, which usually predict a single step / a scalar target, it ambitiously predicts all the future covariates in one pass under fixed interventions and shows its effectiveness.
Critical weaknesses
-
The training data and the causal quantity of interest are misaligned. The pre-training dataset includes 30% observational trajectories. These trajectories inject confounding to the network.
-
Prior domain knowledge tells us, a generic network does not work well for longitudinal counterfactual outcome prediction. This is the reason why G-Net, RMSN, G-transformer explicitly incorporate the confounding adjusting into the architecture. CLPFN does g-computation via recursive one-step prediction. This paper, however, does not have the design that can address the time-varying confounding issue (the mask can do partly, but not enough for causal adjustment). Yet, it claims superiority over existing baselines without proper justifications.
-
The experiment is weak. The experiment does not answer the question: is the gain from adjusting for time-varying confounding? In addition, Ablation studies over key designs are also missing.
Questions for authors
See weaknesses above.