- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Geodesic Conformal Risk Control (GeoCRC), a framework for image segmentation that aims to control instance-level miss risk while improving the spatial coherence of prediction sets. Compared to the original Conformal Risk Control (CRC), which is based on pixelwise thresholding, GeoCRC applies isotonic regression to calibrate pixelwise probabilities, extracts high-confidence seed regions, and finally constructs nested prediction sets through multi-source geodesic propagation. Experiments on four segmentation datasets with multiple backbone architectures show improvements in boundary accuracy and prediction fragmentation compared to the original CRC baseline.
Critical strengths
- The paper studies an important limitation of pixel-level risk metrics in image segmentation, more specifically, their potential to undersegment small target instances. The use of a connected-component-level miss loss is well motivated for applications where missing individual objects may be consequential.
- The proposed method combines probability calibration, seed-based geodesic propagation, and CRC in a conceptual pipeline while retaining the original CRC guarantee.
- The experiments cover four datasets and four segmentation architectures. The results show substantial reductions in boundary error and false positive components compared to the raw pixel-threshold CRC.
Critical weaknesses
- The main experiments primarily compare GeoCRC against raw pixelwise thresholding with CRC. The proposed approach incorporates spatial structure through seed selection and geodesic propagation, whereas the baseline does not exploit spatial relationships. This makes it difficult to determine whether the observed improvements arise from the specific geodesic formulation or simply from introducing spatial regularization.
- The framework mainly combines established techniques, including isotonic regression, geodesic propagation, and standard CRC calibration. The theoretical guarantee follows directly from the nestedness of the constructed prediction sets and the existing CRC theorem. While the combination is reasonable, the paper provides limited theoretical or empirical insight into why the particular geodesic construction should be preferable to other spatially structured prediction families.
Questions for authors
- Could the authors include more competitive spatially aware baselines, such as morphological post-processing or spatial smoothing combined with CRC, to better demonstrate the effectiveness of GeoCRC?
- ould the authors compare GeoCRC with simpler distance-based region-growing methods under the same input information and calibration settings to isolate the contribution of geodesic propagation?
- The authors acknowledge several spatially aware conformal methods (Bereska et al., 2025; Mossina et al., 2025; Gaillochet et al., 2026). Why are these methods not included as baselines, and could they be adapted to the same instance-level risk objective for a fair comparison?
Thank you for your response. I still have significant concerns regarding the novelty of the proposed idea and whether its contributions are substantial enough for a serious ML publication. In particular, the improvements appear quite incremental, and the original manuscript contains considerable weaknesses in its presentation and writing. Therefore, I will maintain my original score.