- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2(+1)
Read review
Paper summary
This paper investigates the challenges associated with converting general high-dimensional multivariate prediction regions into box-shaped prediction sets. The authors point out that such a conversion may lead to excessive coverage, resulting in overly conservative prediction sets, or may invalidate the original coverage guarantees. To address these issues, the authors propose directly calibrating nested box-shaped prediction sets to obtain smaller boxes while maintaining coverage guarantees. Furthermore, they extend this approach to the online setting by incorporating existing adaptive conformal calibration methods and further improve prediction efficiency by estimating coordinate-wise scales.
Critical strengths
The paper clearly highlights the distinction between the original prediction regions and the resulting box-shaped prediction sets, and theoretically characterizes the potential issues arising from this conversion.
Critical weaknesses
(1) The problem considered in this paper appears somewhat artificial. If the goal is to construct box-shaped prediction sets, a more natural approach would be to calibrate such sets directly, rather than first constructing general prediction regions and then converting them into boxes. Although the paper provides several theoretical results, the practical significance of addressing this conversion problem remains unclear.
(2) The extension to the online setting appears largely incremental. It mainly adopts an existing adaptive conformal calibration approach similar to that of Gibbs et al., without introducing substantial methodological innovations. Therefore, I do not consider this extension a significant contribution of the paper.
Questions for authors
-
The Introduction does not clearly explain why box-shaped prediction sets are needed or why prediction regions of other shapes need to be converted into boxes. Could the authors provide more concrete examples or practical motivations for considering such a conversion?
-
The presentation of the paper could be improved. The authors introduce too much mathematical notation, making the paper difficult to follow. Moreover, several theoretical results, particularly Theorem 2, are not stated clearly. I suggest simplifying the notation and presenting the main theorems in a more concise and accessible manner.