- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies medical image segmentation under an expected False Discovery Rate (FDR) constraint. It formulates the task as minimizing the False Negative Rate (FNR) subject to a user-specified FDR level. Since FDR is non-monotonic with respect to the prediction threshold, the authors argue that standard Conformal Risk Training (CRT) cannot be directly applied.
The paper proposes Reversed Conformal Risk Training (R-CRT). Instead of directly imposing the non-monotonic FDR constraint during training, R-CRT uses a monotonic FNR proxy constraint to determine per-sample thresholds, aggregates them with a soft quantile, propagates gradients through the threshold-selection step using implicit differentiation, and gradually tightens the proxy constraint through dynamic annealing. After training, the model is frozen and calibrated with Conservative Conformal Risk Control (CRC-C).
Experiments are conducted on several medical image segmentation datasets, with multiple backbones, target FDR levels, annealing strategies, threshold aggregation schemes, and controlled training baselines.
Critical strengths
-
The paper addresses a meaningful risk-constrained segmentation problem involving the trade-off between false discoveries and missed targets.
-
R-CRT provides a coherent algorithmic strategy for handling the non-monotonicity of FDR through a monotonic proxy, implicit differentiation, soft-quantile threshold aggregation, and dynamic annealing.
Critical weaknesses
-
Insufficient positioning against prior work.
The paper does not clearly establish its novelty relative to prior work on non-monotonic conformal risk control, particularly Angelopoulos (2026) and Aldirawi et al. (2026). These methods are mentioned but are not sufficiently discussed or directly compared. The experimental baselines also do not appear to cover all directly relevant methods for non-monotonic FDR control and conformal training. -
Incomplete theoretical justification of the reversed formulation.
The paper does not establish a formal relationship between the proxy FNR constraint used during training and the target FDR constraint used after calibration, nor does it prove that the proxy optimization is equivalent to the original FDR-constrained objective. The main theoretical guarantee is adapted from prior CRC-C theory rather than being a new convergence, optimality, or generalization result for R-CRT. Moreover, the practical bootstrap estimate of the stability parameter is not a strict deterministic upper bound, so the implemented procedure does not directly instantiate the stated finite-sample guarantee. -
Incomplete isolation of the method’s components.
Although the paper includes several ablations, they do not fully isolate the contributions of task reversal, implicit differentiation, dynamic annealing, and soft-quantile aggregation. The sensitivity to calibration-set size, quantile parameters, smoothing temperatures, and annealing choices is also not fully analyzed. -
Limited analysis of empirical behavior and theoretical assumptions.
The experimental discussion is mostly descriptive. It provides limited analysis of failure cases, instability across datasets or data splits, the empirical behavior of the stability adjustment, and the relationship between the observed results and the assumptions underlying the theoretical guarantee.
Questions for authors
Please see Weaknesses.