- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies robust aggregation of a fixed dictionary of regression predictors under covariate shift with squared loss. The authors introduce a dictionary-dependent pairwise overlap coefficient and build a robust Q-aggregation procedure using median-of-means estimates of pairwise risk differences and distances, Euclidean distance-matrix repair, and a variational-inequality aggregation step.
Critical strengths
S1. The use of pairwise loss differences avoids unnecessarily strong moment requirements.
S2. The paper addresses two genuine consistency problems created by coordinatewise robust estimation.
S3. The connection to classical Q-aggregation is conceptually useful.
S4. The theory includes matching lower bounds for the main rate dependence.
Critical weaknesses
W1. The method assumes the density ratio is known exactly, which removes one of the main practical difficulties of covariate shift.
W2. Some assumptions (e.g. uniformly boundedness) are strong.
W3. The finite-sample oracle bound has extremely large constants and is often practically vacuous.
W4. The empirical results do not show a compelling predictive advantage for the proposed method.
W5. The algorithm is quite complicated and its individual ingredients are largely established tools.
W6. It seems that the real-data experiments do not involve naturally occurring covariate shift.
W7. The paper does not study robustness to violations of the exact covariate-shift assumption.
Questions for authors
See weaknesses.