- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper develops an instrumental-variable framework for continuous-time stochastic systems with latent confounding. It encodes IV assumptions in the infinitesimal drift and derives moment restrictions relating prediction residuals to the instrument’s history. For Ornstein-Uhlenbeck processes, it establishes identification under a controllability condition and provides a consistent integral-based estimator. It further proposes a signature-kernel estimator for nonlinear drift functions. Experiments on synthetic systems and a diabetes-inspired simulator demonstrate advantages over likelihood estimation that ignores hidden confounding and existing discrete-time IV baselines.
Critical strengths
-
The paper clearly explains why IV sparsity in continuous-time drift does not generally survive finite-time discretization, identifying a substantive source of model misspecification.
-
The connection between causal identification and controllability provides a principled explanation for how a single instrument process can identify multiple parameters. The consistency result complements this identification analysis.
-
Experiments varying confounding and instrument strength support the proposed mechanism and illustrate the expected trade-off between bias reduction and estimation efficiency.
Critical weaknesses
-
While the paper derives valid conditional moment restrictions, these restrictions do not necessarily identify a unique nonlinear causal drift. Multiple candidate functions may satisfy the same restrictions, and regularization selects among these candidates without necessarily recovering the true mechanism. The paper explicitly acknowledges this limitation, but it leaves a substantial gap between the nonlinear estimation framework and a guarantee of causal recovery.
-
In the RBF experiments, the estimator uses the same basis-function centers and bandwidth as the ground-truth drift, reducing the task to coefficient estimation within a correctly specified function family. Although this is a useful controlled evaluation, it provides limited evidence that the method can recover nonlinear causal mechanisms when their functional form is unknown.
Questions for authors
N/A
3 comments
W2: Performance with a unknown functional form
Thanks for this suggestion. So far, beyond the kernel based experiments, we had one short experiment with a neural network parameterization (l.450 onwards), which is a much more flexible representation of the drift function.
To corroborate our claims in the nonlinear setting, we performed the following additional experiments to show that other flexible parameterizations can also recover the true drift function in the RBF-kernel-based setting (so using the same representation with same centers and width is not necessary). We compare three increasingly flexible parameterizations of the drift function: a full basis-function expansion, a partial neural parameterization , which retains linear terms in and and uses a neural network to model the nonlinear RBF component, and a fully flexible standalone neural network. For completeness, we also add the naive MLE baseline (which ignores the unobserved confounder) to the comparison.
Table 1 Drift function MSE over the joint distribution of with standard errors across five seeds.
| Method | Function MSE (SE) |
|---|---|
| RBF-basis MLE | 0.1034 (0.0005) |
| RBF-basis IV | 0.0134 (0.0018) |
| Additive neural drift IV | 0.0354 (0.0041) |
| Full neural drift IV | 0.0775 (0.0015) |
Our IV method recovers complex drift functions across different types of functional parameterizations even when the full flexibility of a neural network is used. All parameterizations outperform the MLE estimate and we clearly observe that the heavier we restrict the parameterization (while still being able to represent the true drift), the better the MSE. (As parameterizations become more flexible, the identified set grows.)
We added a plot to appendix I.4 (Fig.5-7) showing that the learned networks trace out the complex shape of the RBF-based function with high precision and also present an additional experiment demonstrating that a sine-shaped drift can be recovered as well.
Dear reviewer 46E2, As the discussion window draws to a close, we wanted to gently check in to see if our rebuttal has successfully addressed your concerns. If any questions remain, we are very happy to clarify them before the deadline, and we would appreciate it if you considered re-evaluating your scores. Thank you for your time and effort!
W1: Non-identification in the nonparametric setting
Yes, non-identification is an interesting inherent characteristic of the IV setting. More broadly, non-identifiability cannot be addressed on the level of methodology or collecting more (of the same) data. Whether a target parameter is identifiable from observational data solely depends on the modeling assumptions. That leaves to directions: (a) One can add on stronger, more restrictive modeling assumptions until the target parameter is identified. (b) One accepts and grapples with the fact that the target parameter is not identified.
Large parts of statistics intentionally focus on (a) and only deal with models in which the target parameter is identifiable by design. This commonly leads to misspecification. For example, in cause effect estimation, some typical assumptions to render causal effects identified are no unobserved confounding, consistency, and overlap. The IV approach explicitly acknowledges that in many settings the no unobserved confounding assumption is too restrictive. With additional assumptions such as linearity (and in the static case sufficiently rich instruments) full identifiability can be restored. But in the non-linear/non-parametric setting, non-identifiability is an intrinsic property of the IV model (also in the static case).
When multiple causal effects are compatible with the observed data, one can either try to characterize the entire compatible set, or find specific elements. Finding the least norm element is a common approach and has been thoroughly studied in the literature for the static case (Zhang et al., 2023, Bennett et al., 2023, Dikkala et al., 2020). However, one could also find the element closest to the MLE estimator or some other parameter of interest (called "Anchor regression") or aim for bounds of causal effects (Rothenhausler et al., 2021, Kilbertus et al., 2020). These are both active areas of ongoing research.
Summary:
Non-identification in our nonlinear setting is an inherent property of the setup. It cannot be fixed by methodology or better estimators. We follow existing literature on the static setting in finding a minimum norm solution in the identified set.
References:
Bennett, A., Kallus, N., Mao, X., Newey, W., Syrgkanis, V., & Uehara, M. (2023). Minimax instrumental variable regression and l2 convergence guarantees without identification or closedness. In G. Neu & L. Rosasco (Eds.), Proceedings of Thirty Sixth Conference on Learning Theory (Vol. 195, pp. 2291–2318). PMLR.
Canay, I. A., Santos, A., and Shaikh, A. M. (2013). “On the Testability of Identification in Some Nonparametric Models With Endogeneity.” Econometrica, 81(6)
Dikkala, N., Lewis, G., Mackey, L., & Syrgkanis, V. (2020). Minimax estimation of conditional moment models. In Proceedings of the 34th International Conference on Neural Information Processing Systems (NeurIPS '20).
Kilbertus, N., Kusner, M. J., & Silva, R. (2020). A class of algorithms for general instrumental variable models. Advances in Neural Information Processing Systems.
Rothenhaeusler, D., Meinshausen, N., Buehlmann, P., & Peters, J. (2021). Anchor regression: Heterogeneous data meet causality. Journal of the Royal Statistical Society.
Zhang, R., Imaizumi, M., Schölkopf, B., & Muandet, K. (2023). Instrumental variable regression via kernel maximum moment loss. Journal of Causal Inference