- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies learning a policy with unobserved confounding. In the proxy/bridge learning setting, it is assumed that there is some observed "proxy" variable for the hidden confounding, W, which affects only the treatment and not the outcome. The "bridge equation" looks for a (unique) function of treatment A, W, and covariates X (only) that exactly matches the observed outcomes (which depend on the full hidden confounding, U). This paper broadens this framework to consider a set of bridges that are not unique and/or may only approximately match the observed outcomes. In that case, we need to be able to compare policies whose predicted outcome may depend on the bridge model used. The paper gives a concrete procedure for comparing policies by minimizing regret across feasible bridge models, and a tractable convex optimization to search for policies that minimize worst case regret.
Critical strengths
Learning policies with unobserved confounding is an important problem. The hard part is generally to come up with setting / assumptions that are realistic enough to be useful, but still allow for non-trivial results. I thought the setup proposed sounded intuitive and useful. Previous work considered that a proxy for hidden confounding that affects only the treatment may be available - but only if there is an identifiable "bridge" model that connects the proxy and outcomes. What I like is that this work doesn't assume the (unrealistic) case that we get perfect identifiability of the bridge equation. That seems much more useful, allowing us to use imperfect confounder proxies to still decrease our regret in policy learning.
I'm familiar with causal inference in general, but not this particular literature, but I found the writing and setup to be clear and interesting. The notation used to define everything looked logical.
Experiments using semi-synthetic data validate the approach and test the effects of different bridges and the impact of the convexification.
Critical weaknesses
I did not notice any critical weaknesses, but I'm not familiar with this literature so did not follow everything in Sec. 5.
Minor comments
No need to discuss these or even take them into account, as some of this may just be due to conventions of the sub-field.
- I would have liked a little more concrete motivation in the intro. E.g. "We want to test policy for drug A, but people who have access in the study may have more resources and this affects outcome - hence W could represent socioeconomic proxy (zip code, income)." I realize, though, that it is surprisingly not common in this type of literature to do this. And, maybe the previous proxy works have covered this so it seems unnecessary.
-
- I didn't know what the cond. moment equation was. Later it is stated that means Eq. 1 - I guess that wasn't obvious to me from the form.
-
- that Pi - Pi notation looks strange.
Questions for authors
No major questions, see above. I'll read the other reviews and rebuttals and take these into account in final review.
8 comments
Response to Reviewer 6cn4 (1/3)
Thank you for recognizing the value of policy learning with nonunique bridges and the clarity of the formulation! We address the concrete motivation, conditional moment equation, and policy notation below.
[M1] A concrete motivation from RHC
The added Right Heart Catheterization (RHC) application illustrates why different admissible bridges can lead to different treatment recommendations.
1. The application assigns RHC probabilities by age group using observed proxies for unmeasured illness severity.
The cohort contains 5,735 critically ill patients (Connors et al., 1996). Treatment indicates first-day RHC, outcome is survival truncated at 30 days and divided by 30, and contains deployment covariates. Unmeasured illness severity may affect both RHC use and survival, confounding a direct treatment comparison.
Following Cui et al. (2024), we use blood pH and hematocrit as outcome-inducing proxies , and oxygenation and carbon dioxide measurements as treatment-inducing proxies . Policies choose separate treatment probabilities for patients younger than 65 and those aged 65 or older.
2. If admissible bridges rank these policies differently, selecting one bridge can change the recommendation.
Following your suggestion, the revised Introduction uses this example to explain the decision problem concretely.
Thus, our method addresses the uncertainty in treatment recommendations by retaining the joint bridge restrictions and minimizing worst-case regret.
Response to Reviewer 6cn4 (2/3)
[M2] The conditional bridge equation and proxy roles
The bridge equation equates conditional means, so multiple bridges can satisfy it without reproducing each individual's outcome.
Please allow us to clarify the equation and the proxy roles.
1. The equality is conditional on observed treatment, treatment-inducing proxies, and deployment covariates.
In Section 3.1, and , so means
Here, is the bridge for observed treatment . The equation requires equal means conditional on , not for every individual. Several bridges can satisfy the same equation exactly.
2. is the outcome-inducing proxy and is not assumed to affect only treatment.
Assumption 1 requires
where denotes conditional independence. Section 3.1 now spells out the conditional-mean equation alongside the stated proxy roles and assumptions.
Thus, several bridges can satisfy the same conditional mean equation under the stated proxy assumptions.
Thoughts on rev. 4qwy discussion
I'm following the discussion with 4qwy, who declared high confidence for this review.
I didn't find this argument the most compelling - all of causal inference is about finding minimal, reasonable assumptions that allow for causal conclusions. Intuitively, the assumptions seemed reasonable to me, and the authors do propose a way to test the impact of this.
This seemed more interesting - if the bounds are vacuous then the results may be useless. From the rebuttal, it seems that it is true that at practical sample sizes the bounds are loose, but with enough samples they could become tight. This makes me a little ambivalent, though I can imagine that rankings are meaningful even if bounds are loose, though I don't recall anything like that being tested. And it does change the impact of the contribution.
If the bounds are quite loose, some empirical causal benchmarks might be useful, I agree.
For [Q1], I haven't read this literature, so hope to see if 4qwy agrees with the author response clarifying the contribution.