- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper develops inference for Makarov bounds on treatment effect distributions without a margin assumption. Smoothing the nonsmooth operators removes the need for unique optimizers, while influence function corrections yield efficient, asymptotically normal estimators of the smoothed bounds for fixed smoothing parameters. One-sided corrections for smoothing bias provide asymptotically conservative confidence intervals for the treatment effect distribution. It also proposes selecting smoothing parameters from the data. Simulations show lower MSE than the baselines, and real A/B tests illustrate how the bounds can inform launch decisions.
Critical strengths
The paper extends Makarov bound inference to settings with nonunique optimizers, where standard envelope guarantees no longer apply. For fixed smoothing parameters and a fixed evaluation threshold, explicit one-sided corrections yield asymptotically conservative confidence intervals for the original treatment effect CDF under the stated regularity conditions.
Critical weaknesses
Data-driven smoothing parameter selection is one of the main contributions, but the current analysis does not justify the claim that this selection is optimal.
-
Equation (16) in Section 4.3 replaces the squared smoothing bias in Equation (15) with . However, Equation (6) in Lemma 4.1 only establishes , not a bound on the absolute or squared bias. Thus, Equation (6) does not justify this replacement.
-
The Lepski rule in Section 4.3 ranks candidates by in Equation (6), with comparison standard errors given by Equation (17). When , ignores , although controls the supremum approximation in Equation (4). Thus, this ordering does not generally reflect the candidates' approximation errors.
Questions for authors
-
Should the variance term in Equation (16) be rather than to match Equation (15)? Why do the risk bounds in Table 1 differ from those in the text ( versus , and versus )? What acceptable risk threshold supports the conclusion that a treatment is safe to launch?
-
The efficiency results concern smoothed bounds with fixed smoothing parameters. What theoretical guarantee supports the claimed optimality for estimating the original bounds after data-driven tuning?
-
Does Appendix C recover sharp bounds for discrete outcomes? Without covariates, consider identical Bernoulli$(1/2)$ marginals at . All candidate differences used in Equation (64) are zero, so Equation (67) converges to as . However, , and the sharp bounds are . Thus, the concern is not that the bounds are invalid, but that they fail to recover the claimed sharp bounds. How should ties be handled, and would correcting the formulas in Appendix C affect the TWINS results in Figure 6?