- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
DiPPI uses predictive distributions rather than only point predictions to improve statistical inference with limited labels. It learns the conditional expectation of the estimating function and combines this with residual correction, cross-fitting, and matrix calibration. The theory characterizes when distributional information improves asymptotic efficiency. Simulations and Wine, Forest, and Politeness applications evaluate estimation error, confidence-interval width, and coverage.
Critical strengths
The strongest point is the explicit condition for when a predictive distribution adds information beyond a point summary. This makes the efficiency claim precise rather than assuming richer predictions always help. Simulations and three real-data applications support the practical benefit through shorter confidence intervals while retaining coverage close to the nominal level.
Critical weaknesses
The methodological step beyond RePPI appears relatively small: the main change is to give the auxiliary regression richer prediction features. The oracle efficiency comparison confirms that richer conditioning information can help, but does not by itself establish a substantial advance in the inference procedure. The experiments support the usefulness of distributional features more clearly than the need for a distinct statistical framework.
Questions for authors
Which part of DiPPI goes beyond supplying richer auxiliary features to a RePPI-style procedure? Please clarify whether the main advance is a different estimator, additional guarantees, or the characterization of when distributional features help. This distinction matters to my assessment of the methodological novelty.
Response to Reviewer ZS73
We thank the reviewer for the positive assessment, and for identifying the "explicit condition for when a predictive distribution adds information beyond a point summary" as the paper's strongest point. We address the reviewer's question below.
Relationship to RePPI (Question 1 and Weakness 1)
The main advances are the characterization of when distributional information improves efficiency, the newly added procedure for selecting Φ(Q), and additional theoretical guarantees. We detail these contributions below.
(i) When distributional information helps (Section 2.2). We start with the recognition that when more information is available than point predictions for the outcome, we should take advantage of the information beyond the point predictions. Eq. (5) quantifies the oracle efficiency gain from using Q rather than a point prediction Y=T(Q). The gain is zero if and only if E[Uθ⋆(X,Y)∣X,Q]=E[Uθ⋆(X,Y)∣X,Y]. Thus, a gain requires additional information about the estimating score beyond the covariates and the point prediction.
(ii) How to select Φ(Q) (new Section 2.5). We propose a data-driven procedure that selects Φ(Q) from a fixed finite set of candidates, including the predictive mean as a baseline. Specifically, we fit DiPPI using each candidate and select the one with the smallest estimated asymptotic variance for the parameter of interest. Proposition 5 establishes selection consistency and asymptotically valid Wald intervals constructed using the selected representation. All simulations and the Wine and Politeness experiments now use this procedure.
(iii) General estimating equations (Theorems 1 and 2). Our theory covers locally identified roots of smooth estimating equations without requiring a convex loss. The proofs establish existence and local uniqueness of a root through a contraction argument. Appendix E (p. 37) illustrates why this extension matters through nonconvex location estimation and instrumental-variable estimating equation examples.
(iv) Covariance estimation and inference (Theorem 4). Theorem 4 explicitly proves consistency of the cross-fitted covariance estimator in Eq. (10) and asymptotic validity of Wald intervals. The proof accounts for fold-specific corrections and the dependence induced by reusing the same unlabeled sample across folds.
We hope these clarifications and revisions address the reviewer's concerns. We would be happy to address any remaining questions.