- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
In nonparametric additive IV (NPIV) models a structural function (here denoted ) is identified as the unique (under an injectivity condition) solution to a conditional moment restriction. This paper examines distributional robustness of such models. The paper takes an RKHS approach and considers replacing the usual conditional moment restriction (expressed using the RKHS) with a maximum over perturbations of the distribution of observables. The paper uses this as both an analytical device in order to investigate the robustness of identification in NPIV to certain types of misspecification, and also to motivate a robust estimator, which minimizes worst-case (over perturbations) NPIV objective function. There is a trade-off here: more robustness (i.e.,allowing for larger perturbations) can potentially lead to bias when the conditional moment restriction is correctly specified (i.e., it holds at the true ). The paper investigate the trade-offs this using semi-synthetic and real data.
Critical strengths
The idea here is interesting. Robustness is important in NPIV because these models are always misspecified (additive separabiltiy of the causal model is a strong assumption and is at best a good approximation). The proposed approach to distributional robust estimation seems intuitively reasonable in this setting. The paper is fairly thorough in its empirical investigations and the analysis is well thought-through.
Critical weaknesses
The writing could do with some improvements. The introduction is difficult to understand without having read the paper first. There are typos (e.g., "functiosn" on page 2, "conencted" on page 3, "varint" on page 5). is used before it is defined. Some discussion of the literature seems to contrast with what is in those papers, for example the paper claims that Newey & Smith, 2004 "seek the smallest shifts under which the CMR is satsifed and moments approach zero" which is a very strange reading of that paper. One of the biggest problems is that the paper does not clearly state the empirical method it actually proposes: it never points to a particular formula but instead readers are expected to figure this out from the discussion.
The paper does not appear to provide a complete asymptotic theory/inference approach for the proposed method. However, this appears to be a complicated problem so this is a reasonable omission in my opinion.
Questions for authors
How does the present work connect this to recent papers in the econometrics literature which explicitly analyse the failure identification when the conditional moment restriction is relaxed? In particular, https://www.aeaweb.org/articles?id=10.1257/aer.20231765 and https://arxiv.org/abs/1901.01241, the latter of which proposes a robust estimator. The approach in the present work is quite different, perturbing the distribution of observables rather than the moment condition, but the ideas are clearly related. That work should probably also be cited in the paper.
Regarding the proposed empirical method, there are some questions left unanswered. Does the distributionally robust method impart some implicit form of regularization (important given the ill-posedness of the NPIV estimation problem)? Proposition 2 suggests it might, but it was not clear to me whether that interpretation is correct?
Thank you for the careful review, for your assessment of why robustness matters in nonparametric IV, and for the pointers to the econometrics literature.
Summary
The tradeoff for TAN–RMS on the main design (first-stage R2=0.1, Fig. 2):
Details
Regularization. The response term adds τΣq to the normal matrix (1−τ)A⊤A (Prop. 2). For TAN–RMS the estimation error falls with the radius and the bias toward least squares grows beyond κ=1 (Sec. 6.2, Fig. 2). Removing the term at least doubles the error at every evaluated sample size on the main design under the same EB selection rule (App. J). The response term shrinks the IV fit toward the weighted least-squares fit of Y on T, whereas the ridge shrinks the coefficients toward zero. We keep both, and Corollary 1 gives the population target under both. k-class estimators often shrink toward least squares. For linear features and whitened instruments of constant norm, TAN–RMS is a k-class estimator (App. D).
Deaner. By reweighting along a=ε0h(Z) of norm ρ, we obtain Deaner's relaxed restriction EQ[ε0∣Z]=ν0(Z), with ∥ν0/σ∥=ρ (Prop. 1, Sec. 3). In Corollary 1, we show how such a violation ν0 affects our estimator: it passes through the same regularized inverse as the sampling error, so the radius limits the effect of both.
Presentation. We revised the introduction: it no longer refers to undefined terms, and it now explains why controlling small perturbations of the data helps when instruments are weak. We also corrected the related-work paragraph on generalized empirical likelihood. Moreover, we defined the ambiguity set earlier, and streamlined the notation.
We hope this resolves your concerns and would be grateful if you would reconsider your assessment. We are happy to clarify further.