- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes iASIDE, a latent neural-ODE framework for predicting a dynamical system’s response to sequences of interventions, for example tumour growth under chemo- and radiotherapy. The core idea is to make the latent dynamics depend on a per-system parameter c that is inferred from the observed history, rather than only encoding the history into an initial latent state as existing treatment-response models do. Conditioning c on the history also gives an auxiliary variable in the nonlinear ICA sense, which the authors use to utilise known nonlinear ICA identifiability results. The main novelty is a separable formulation: the dynamics are decomposed into a native term plus additive per-treatment response terms. Each response parameter c^k is inferred only from history segments where treatment k was active. Inference is via amortised variational inference. Experiments on synthetic PK-PD tumour data, pendulum image sequences and MIMIC-III show improved forecasting accuracy over standard baselines, particularly at longer horizons and higher heterogeneity.
Critical strengths
The paper brings identifiable latent dynamics into treatment-response prediction, a gap that existing confounding-focused methods leave open. The separable formulation is intuitive and simple, and experiments cover a range of modalities.
Critical weaknesses
I’m struggling to connect the identifiability theory to the model as implemented. Theorem 1 requires G to be injective in c. However, if treatment k does not occur within a prediction window, c^k has no effect on the outcome, so injectivity seems to fail for exactly the parameters the separable formulation introduces. Can you clarify the conditions under which Theorem 1 applies to c^k? Theorem 2 requires a conditional density p(z_t | z_{t-1}, H_T) with independent components and an invertible emission. The model, though, is a deterministic ODE given c, and for tumour volume and MIMIC the outcome is scalar while z is 16-dimensional. Does Theorem 2 apply to all experiments, or only to the Pendulum experiment? If these points could be addressed adequately I would raise my score
Questions for authors
The separable conditioning of native and response parameters on their own history segments is an intuitive and appealing way to tackle the credit-assignment problem. However, identifying c under the observed treatment patterns seems distinct from identifying the response functions f^k, which is what counterfactual prediction under new plans requires. Can you comment on this distinction?
Response
Please see our overall response on Theorem 1 and Theorem 2 which address the two questions raised by the reviewer regarding inactive interventions and the deterministic nature of the ODE when given c.
Does identifying c identify the response functions needed for counterfactual prediction
We agree that they are distinct; Theorem 1 identifies only c. The two play different roles in a counterfactual forecast. In our formulation of the data-generation process, fθk is a global function per intervention, learned jointly with the inference of c from the data of all subjects and shared across subjects and plans. Counterfactual prediction under a new plan therefore does not need a new fθk, but the same one evaluated with different timings or combinations of interventions. Furthermore, for the purpose of counterfactual prediction at the observation level (e.g., what will the trajectory of the tumor volume be), what needs to be recovered is actually the mixing function Ga,zT(cK(a)) (which includes both the latent fθk's and the emission to the data space), along with ck that represent the exogenous variable in the underlying causal process that is specific to a subject. The recovery of Ga,zT(cK(a)) across intervention plans observed in the data, as established in Theorem 1, is thus sufficient for counterfactual prediction, such that the patient's response to an alternative counterfactual intervention plan a′ can be predicted by evaluating G^a′,z^T(c^K(a′)) under the new plan a′ at the subject's recovered c^k's. If a specific intervention plan has never been observed in the data, we will not be able to support their counterfactual prediction within our current theoretical results.