- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes OrthoGen for estimating conditional outcome distributions under time-varying treatments. It fits continuation distributions through backward generative regression and trains a target generator using a longitudinal AIPW objective. It establishes orthogonality and a product-error bound under regularity assumptions. Experiments use normalizing flows and diffusion models on synthetic, semi-synthetic, and real data.
Critical strengths
The framework combines backward distribution learning with a model-agnostic orthogonal objective. Comparisons using common architectures help isolate the effect of the adjustment strategy. The semi-synthetic results show consistent improvements across the tested configurations.
Critical weaknesses
-
The motivation for learning the whole distribution needs stronger support. The backward sequential fitting and AIPW correction build on established methods. The paper should give concrete examples of quantities that users need and demonstrate why one generative model is preferable to targeted sequential estimation. It does not quantify the computational savings from using one distribution model to answer multiple queries.
-
My main concern is accuracy for the quantities ultimately reported. Learning a whole distribution may introduce approximation error for a particular quantity compared with estimating it directly. The bound controls distance to the best generator within the chosen model class, rather than error relative to the true target quantity. Therefore, it does not resolve whether distribution learning improves or worsens bias for means, threshold risks, or quantiles.
Questions for authors
-
What concrete collection of outcome queries motivates learning the whole distribution? For those queries, how do accuracy and total computational cost compare with targeted sequential AIPW estimators?
-
What guarantee does OrthoGen provide for a quantity calculated from its generated distribution, such as a threshold risk or quantile? Can the authors separate generator estimation error from model-class approximation bias and provide a direct empirical comparison with targeted estimation?
4 comments
-
Guarantees of quantities estimated from the distribution.
We thank the reviewer for raising this important point. Our approach aims to learn the optimal generator within a predefined generative model class, which, for sufficiently flexible generative models, can closely approximate the true counterfactual outcome distribution. Since quantities such as conditional means, threshold probabilities, and quantiles are functionals of this distribution, they can be directly obtained from the learned generator.
To further clarify the guarantees for such quantities, we have added a discussion in our new Appendix I.4 (Eq. 150) that decomposes the error of any functional into two components: (i) the estimation error relative to the optimal generator within the chosen model class, and (ii) the model-class approximation bias relative to the true counterfactual distribution.
Theorem 2 controls the former through a model-specific generator discrepancy, while the latter depends on the expressiveness of the generative class. Under suitable continuity conditions, distributional approximation guarantees can be translated into guarantees for individual functionals. For example, the absolute error in the conditional mean is bounded by the Wasserstein distance between the estimated and true distributions: . For conditional quantiles, analogous guarantees can be obtained under regularity conditions.
Importantly, the generative objectives employed by our backbones are designed to approximate the true outcome distribution. Maximum likelihood for NFs minimizes the forward KL divergence, while denoising score matching for DMs targets the scores of the underlying perturbed distributions. Under suitable regularity conditions and sufficient model capacity, these objectives can recover the true distribution at their population optima, making the model-class approximation bias small.
=> Thus, flexible generative models provide a principled approach to estimating multiple distributional functionals, while the decomposition above makes explicit the role of finite-capacity approximation error.
Action: We have clarified these theoretical connections in Appendix I.4 and complemented them with direct empirical comparisons against dedicated mean and quantile estimators in Appendix I.1–I.2.
We thank the reviewer again for their constructive feedback, which has helped us strengthen both the motivation and empirical evaluation of our work. We hope that the additional comparisons and theoretical discussion clarify the benefits and limitations of learning full counterfactual distributions relative to directly targeting individual functionals. We would be happy to provide any further clarifications or address additional questions or suggestions.
References:
[1] Kennedy, Edward H., Sivaraman Balakrishnan, and Larry A. Wasserman. "Semiparametric counterfactual density estimation." Biometrika 110.4 (2023): 875-896.
[2] Melnychuk, V., & Feuerriegel, S. (2026, April). GDR-learners: Orthogonal learning of generative models for potential outcomes. In International Conference on Learning Representations (Vol. 2026, pp. 105267-105301).
[3] Yoon, J., Jordon, J., & Van Der Schaar, M. (2018, February). GANITE: Estimation of individualized treatment effects using generative adversarial nets. In International conference on learning representations.
[4] Melnychuk, V., Frauen, D., & Feuerriegel, S. (2023, July). Normalizing flows for interventional density estimation. In International Conference on Machine Learning (pp. 24361-24397). PMLR.
[5] Ma, Y., Melnychuk, V., Schweisthal, J., & Feuerriegel, S. (2024). DiffPO: A causal diffusion model for learning distributions of potential outcomes. Advances in Neural Information Processing Systems, 37, 43663-43692.
[6] Spiegelhalter, David. "Risk and uncertainty communication." Annual Review of Statistics and Its Application 4 (2017): 31-60.
Thank you for the careful response and the new comparison with dedicated mean and quantile estimators, which I appreciate and which makes the paper clearer. My remaining concern is the practical implication. In the new results the targeted estimators are somewhat more accurate for the quantities they target, so the main advantage of learning the full distribution appears to be avoiding retraining, and I am not sure retraining is a real bottleneck in causal inference practice. I think the work is careful and I remain slightly positive.
Thank you for your thoughtful follow-up and for your continued positive assessment of our work.
We would like to emphasize that, although dedicated estimators may be preferable when targeting a single predefined functional, the value of learning full counterfactual distributions extends beyond avoiding retraining. In particular, full distributions provide a unified representation of counterfactual uncertainty, enabling the visualization and comparison of entire outcome distributions under alternative treatments, including differences in tail behavior, dispersion, and multimodality that may be obscured by individual summary statistics. This flexibility can be particularly valuable for patient-specific decision-making, where the quantities of interest may vary across patients or evolve with clinical objectives.
We believe that enabling this richer form of counterfactual inference under time-varying treatments, while maintaining competitive accuracy for individual functionals and providing orthogonality and double robustness, constitutes an important contribution.
We sincerely appreciate the reviewer's constructive feedback, which has helped us further strengthen and clarify our work.
We want to thank the reviewer for their careful review and constructive feedback, as well as for the positive evaluation of our work. We have uploaded a new revision, with several changes highlighted in blue, in response to the concerns of all the reviewers. Below, we address all your concerns.
Motivation for learning the full counterfactual distribution.
Thank you for encouraging us to further clarify the practical motivation for learning CDPOs rather than predefined functionals. We have added a paragraph clarifying the motivation for learning whole distributions in Sec. 3, titled “Why learn the full distribution?” and a clinical example paragraph. In these paragraphs, we summarize the following points:
First, the quantities relevant to treatment decisions may be patient-specific and need not be specified before model training. For example, the risk threshold considered clinically relevant may depend on the patient's health status, comorbidities, or preferences. A fitted CDPO allows clinicians to evaluate such individualized risks, as well as additional quantities of interest identified during clinical assessment, without retraining a separate estimator for each query.
Second, the distribution itself can provide useful information beyond individual numerical summaries. Visualizing the predicted outcome distribution under alternative treatment sequences allows decision-makers to examine differences in dispersion, tail behavior, and multimodality, which, for some distributions, may be obscured by a small collection of predefined functionals.
Third, this flexibility is particularly valuable for multivariate outcomes (our fully synthetic dataset, for instance, has three-dimensional outcome), where clinically relevant decisions may depend on dependencies between outcome components. For example, consider three clinical outcomes with potentially patient-specific thresholds. A treatment decision may depend on the probability that at least two of these outcomes fall below their respective thresholds. This probability cannot generally be recovered from marginal outcome distributions, because it depends on their joint dependence structure. A fitted joint CDPO permits such probabilities to be evaluated for arbitrary combinations of thresholds and outcomes.
Finally, we would like to highlight that the problem of distributional potential outcomes estimation has attracted considerable interest in recent years, with many papers addressing that problem in the static setting (see our extended related work; [1, 2, 3, 4, 5, 6]). Our novelty is to bring doubly robust distributional potential outcomes to the time-varying setting, which is non-trivial.
Action: We have added the paragraphs titled “Why learn the full distribution?” and “clinical example” in Sec. 3, and we have further developed the interest of distributional estimation with a motivation example in the new Appendix I “Functional Accuracy and Computational Cost”.
Comparison with targeted models.
Thank you for this suggestion. We have extended our evaluation with our new Appendix I (Functional Accuracy and Computational Cost) and our new Tables 9 and 10, where we compare the conditional means and quantiles implied by our generative models against estimators directly targeting these quantities. We also include a summary in Sec. 7.
For conditional means, we consider four dedicated learners based on PI, RA, IPTW, and doubly robust (DR) estimation. For conditional quantiles, we implement a direct IPTW estimator based on weighted pinball loss. We use IPTW because extending recursive g-computation and doubly robust estimation to conditional quantiles requires additional quantile-indexed nuisance functions and a more involved sequential construction that is underdeveloped in the existing literature and lies beyond the scope of our paper, as discussed in our new appendix.
On the semi-synthetic benchmark (τ=3), OrthoGen achieves mean and 0.8-quantile RMSEs of 0.0639 ± 0.0143 and 0.0700 ± 0.0132, respectively, compared with 0.0556 ± 0.0098 for the dedicated DR mean learner and 0.0587 ± 0.0135 for the dedicated IPTW quantile learner.
=> While targeted estimators can achieve higher accuracy for the specific quantities they are trained to target, OrthoGen remains competitive and, importantly, it learns the full conditional distribution rather than optimizing either functional directly. As a consequence, the same fitted model provides both quantities without retraining.
Action: We extended our empirical evaluation with comparisons against dedicated conditional-mean and quantile estimators (new Tables 9–10, Appendix I.1–I.2), and summarized the findings in Section 7.