- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies CATE estimation when individual treatment assignments are hidden and only noisy pooled treatment reports are available. The main contribution is a characterization of the minimax rate for CATE estimation, consisting of the usual nonparametric regression rate and an additional term accounting for uncertainty in the reporting mechanism. The authors characterize how validation and propensity score variation affect this rate and construct a rate-optimal estimator. In simulations, the proposed estimator performs worse than the zero-effect estimator across all 90 settings.
Critical strengths
None
Critical weaknesses
The paper is poorly written, and the problem is not clearly explained or motivated. I do not find the quality of the paper suitable for ICLR.
My main concerns are the following:
-
The observation model is poorly motivated and explained. Near the bottom of page 2, the authors state that each pool provides a report on its true OR status . Thus, indicates whether anyone in the pool received treatment, while is a noisy measurement of this quantity. Why is this particular observation model of interest? The authors should provide a concrete example of when such data would arise. Moreover, sensitivity and specificity are introduced without explicitly defining them in terms of conditional probabilities. Similarly, the paper repeatedly refers to "channel calibration" without clearly defining what this means. Presumably, it refers to estimating the unknown reporting mechanism, but this should be explicitly stated. Given that these concepts are central to the paper, the lack of clarity in their presentation is particularly concerning.
-
The main theoretical result has very limited scope. The authors acknowledge in Section 4 that validation can improve the minimax convergence rate only when and , with sufficiently small propensity variation. For , the standard CATE regression rate is already attained without validation. This substantially limits the significance of the main result.
-
The proposed estimator performs worse than the trivial zero estimator in every simulation setting. Section 6 reports that the estimator has higher mean squared risk than simply estimating across all 90 settings. This seriously undermines the practical relevance of the methodology. The paper also lacks convincing comparisons with simpler estimators.
Questions for authors
None.