- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies selective prediction under normalized joint density-ratio shifts. Its main contribution is an exact worst-case binary selective-risk formula determined by source coverage and accepted error rate.
Critical strengths
Its main contribution is an exact worst-case binary selective-risk formula determined by source coverage and accepted error rate.
Critical weaknesses
The manuscript is difficult to follow due to an overabundance of notation introduced without clearly motivating or defining the primary target function. The authors aim to maximize $C_{\Gamma}(a_{\tau}) $ subject to a worst-case error constraint, which is counterintuitive; in selective prediction, abstention serves primarily as a safety mechanism, making the maximization of this specific expectation questionable. Furthermore, their formulation of the worst-case error critically omits the predictor . On the theoretical side, the paper fails to establish convergence rates. Empirically, the numerical experiments lack comparisons with established baselines, despite existing literature in this area. The authors also fail to evaluate their method on real-world datasets, which is highly problematic as the assumed robustness conditions may not hold in practice. Finally, the paper lacks crucial guidance on how to select the parameter .
Questions for authors
None