- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of generating (conditional) time series by incorporating Pearl's ladder of causation, explicitly allowing the generation of interventional and counterfactual samples under an intervention on a specific context. For this, the authors assume a causal structure where a context variable C impacts the observed time series X and both are (potentially) confounded. Here, the novelty stems from adjusting for the unobserved confounder, modeled as a learned bank of latent environments, when allowing interventions on the context. The method has been evaluated on simulated and real-world data in terms of the quality of the generated.
Critical strengths
The paper makes an important distinction between purely correlation-based and causally motivated generators. The biggest strength here is allowing for unobserved confounders that impact both the context variable (the one of interest for interventions) and the observed time series. The crucial difference from a 'classical' backdoor-adjustment setting is that the confounder is not observed and has to be inferred from the data, i.e., adjusting for it correctly under a given intervention on C is a non-trivial problem.
Critical weaknesses
The novelty of the work relies on the confounder being unobserved, as it is otherwise a 'typical' setting that can be addressed with standard backdoor adjustment and any conditional generative model. However, the paper does not show that the learned hidden confounder actually performs the adjustment as expected. That is, the paper does not state the assumptions under which the learned (clustered) confounder properly represents the hidden confounder (i.e., what the actual condition is that allows it).
Questions for authors
The work is generally promising and I have a few clarifying questions:
- Since the adjustment for the hidden confounder is a critical part here, under what assumptions does the learned bank provide a valid adjustment? This is probably my biggest concern here, the lack of a clear formal assumption (and in what sense it is violated in practice).
- Generally, I see why a diffusion model is a good tool here, but what is the theoretical novelty beyond using diffusion models for the estimation part, which could in principle be done with any other conditional generative model?
- You are advertising counterfactuals, but Pearl's classical (unit-level) formulation first recovers the exogenous noise of the specific unit. This gives a point estimate whenever that noise is determined by the observation (e.g., in additive noise models). This noise-reconstruction step is missing here. In your case, the abduction step only infers the environment weights, and the counterfactual is then sampled from fresh Gaussian noise, even though the diffusion model could in theory allow it. How would you model point estimates of counterfactuals here, as it seems we can only get a distribution? To clarify what I mean: If we assume an additive noise model Y = f(X) + N, given (x, y) one could first reconstruct the noise via n = y − f(x) and then compute the counterfactual under do(X := x') as y' = f(x') + n. How would this work in your setup?
3 comments
I want to thank the authors for their response! Regarding my first question, I was wondering more about whether there are sufficient conditions on the data-generating process, rather than on the learned bank, under which the learned environments provide a valid adjustment.
Regarding the counterfactuals in Pearl's framework, since only the environment is abducted and the remaining noise is redrawn, it seems to coincide with a rung-3 counterfactual only if the environment captures all exogenous variation (otherwise it is closer to a rung-2 interventional distribution conditioned on the abducted environment). It would help to state this assumption and formally distinguish the two rungs (it is not necessarily weakening the work, just clarifying its scope).
Response to Reviewer's Follow-Up
Thank you for the kind follow-up and for clarifying these points!
(1) On the data-generating process, a sufficient set of conditions under A1-A2 is: (B1) depends on only through a finite-valued with values, (B2) every queried lies in the support of for every , and (B3) the joint distributions belong to a family whose finite mixtures are identifiable. Under B3, the observational distribution determines the weights and the components up to relabeling, and B2 gives at every queried . Because blocks the backdoor path , is then identified from observational data, and a bank that reproduces with these components realizes A3 up to relabeling. These conditions establish identifiability, and recovery by CaTSG's training is not guaranteed.
(2) On counterfactuals, thank you for the helpful suggestion. Formally, CF-TSG targets , an interventional distribution averaged over the abducted environment posterior. It coincides with Pearl's rung-3 counterfactual when is determined by .
We have incorporated both points into Section 4.1 and Appendix H.3 of the updated PDF, and we hope this makes the assumptions and scope clearer. Thank you again for the helpful discussion!
Response to Reviewer RrjM
We thank the reviewer for the constructive comments and for recognizing the adjustment for an unobserved confounder of both context and series as the non-trivial part of the problem. We address each of your concerns point by point below.
Q1. Assumptions under which the learned bank gives a valid adjustment. We thank the reviewer for raising this central question. Under the SCM assumptions A1-A2 (Section 4.1), adjusting for the latent confounder E gives the backdoor decomposition P(X∣do(C))=∑eP(X∣C,e)P(e) (Eq. 2). Because E is unobserved, as stated in Section 4.3 and Eq. 6, CaTSG replaces it by the index Z∈{1,…,K} of a learned environment bank and aggregates the K environment-conditioned branches with weights produced by EnvInfer. Given the reviewer's concern about whether the learned bank properly represents the hidden confounder, this replacement preserves the decomposition under two sufficient conditions:
Under A1-A4, ∑kP(X∣C,Z=k)P(Z=k)=P(X∣do(C)). Regarding the reviewer's question of in what sense these conditions are violated in practice, the current training objective enforces neither condition, and each can fail. A3 is violated when the finite bank merges values of E that have different outcome mechanisms P(X∣C,E), for example because K is too small. A4 is violated when EnvInfer's weights differ from the required ones, since swapped prediction does not constrain EnvInfer to recover them. We therefore evaluate the resulting generator end to end against a directly constructed interventional target: on Harmonic-VM, across five training runs, CaTSG is closer to this target than the same-backbone w/o Env in all 16 metric-marginal comparisons (Table 8). To make these conditions explicit, we now state them formally in Appendix H.3 and summarize them in Section 4.1.
Q2. Novelty beyond using diffusion for estimation. We thank the reviewer for this question. As stated in Sections 1 and 4, our contribution beyond using diffusion as an estimator is the formulation of causal time series generation as a task family spanning observational, interventional and counterfactual generation, together with a time-series-specific construction of these targets under latent confounding. Section 4 introduces backdoor adjustment and abduction-action-prediction as two classical tools and adopts diffusion as the generative backbone, so diffusion is the instantiation, not the source of causal identification. Our methodological contribution is to translate these causal targets into a unified conditional time series generator with a learned finite environment representation and environment-conditioned score branches. Appendix H.6 distinguishes this formulation and construction from prior causal generative models.
Q3. Unit-level counterfactuals and noise abduction. We thank the reviewer for this question. As stated in Section 4.1 and the limitations, our current CF-TSG target is deliberately distributional: it preserves the inferred factual environment information while resampling residual generative uncertainty. We therefore do not claim unit-level identification of the exogenous noise or a unique counterfactual point estimate. A point-estimate extension could use a deterministic diffusion inversion: map the factual x0 to a sample-specific latent under (c,w) and decode the same latent under (c′,w), the diffusion analogue of n=y−f(x) followed by y′=f(x′)+n. However, identifying that latent with the exogenous noise of the SCM would require additional invertibility and structural assumptions that our formulation does not impose. Nevertheless, we agree with the reviewer that unit-level noise abduction is a valuable direction for future work.
Thank you again for the valuable comments. We hope our responses address your concerns, and we would be grateful if you could consider raising your score. Please feel free to let us know if you have any further questions; we are happy to discuss them.