acceptodds
Withdrawn from ICLR 2027

FADE: Post-Hoc Failure Detection and Uncertainty Estimation Across Classical and Vision Foundation Models

Withdrawn from ICLR 2027, so left out of the paper lists and the map.

Abstract

Vision Foundation Models (VFMs) have set new standards in zero-shot and open-vocabulary segmentation and object detection. Yet reliably assessing their predictions remains a central challenge: model-reported confidence scores are often poorly calibrated. We introduce FADE, a generic post-hoc framework that trains meta-classifiers to discriminate correct from incorrect predictions based on a predefined IoU threshold, using a common representation built from model-reported confidence, geometric features, and semantic information from a frozen vision-language encoder (CLIP). Requiring neither modifications to the underlying model nor access to its internal representations, FADE is fully model-agnostic and applies to classical as well as modern VFMs, spanning both segmentation and object detection. We use FADE to systematically compare prediction reliability between classical and foundation models across multiple datasets and tasks. Our results demonstrate that FADE reliably estimates the probability of success for both model types using this model-agnostic representation. Moreover, in terms of Expected Calibration Error (ECE), estimating this probability of success is harder for foundation models than for classical models. This points to a concrete limitation in the reliability of current VFMs, which a trustworthy predictor should not exhibit. Our code is publicly available at TBA.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
Uncertainty Estimation, Failure Prediction, Vision Foundation Models, Meta-Classification, Model Calibration, Object Detection and Segmentation

Reviews

Among:
Shape:
1234this paper, Bottom 10%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 1.67 over 3 reviews, above 10% of the others.
Reviewer_kYSuOpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper introduces a post-hoc approach for failure prediction in object detection and instance segmentation. The proposed FADE framework trains a meta-classifier, a lightweight feedforward network, to predict the probability that a prediction of the base model is correct (IoU with a same-class ground-truth object above a threshold τ\tau). Its input combines four families of features: semantic features extracted with CLIP, geometric features, the score of the base model, and optionally task-specific structural features. Experiments are conducted with various classical models and Vision Foundation Models (VFMs) on the public COCO, Pascal VOC and Cityscapes datasets, and on two non-public domain-specific object detection datasets (fish detection and surgical instruments).

Critical strengths
  • Failure prediction for detection and segmentation is a highly relevant problem, especially for VFMs used zero-shot.
  • The method is simple and relevant.
  • Experiments are conducted across different datasets and with a wide range of models: six classical models and five VFMs on COCO, Pascal VOC and Cityscapes.
Critical weaknesses
  • Methodological novelty is limited: FADE essentially combines MetaSeg/MetaDetect-style meta-classification with CLIP crop features and score/geometry recalibration in the spirit of Küppers et al. The contribution is therefore mainly empirical.

  • Weak baselines. Apart from the raw score, all comparisons are ablations of FADE itself. The configuration tit_i, presented as the MetaSeg/MetaDetect baseline, is a stripped-down version of these methods: a few size and perimeter statistics. It lacks what makes them effective: the softmax dispersion measures (MetaSeg), the pre-NMS candidate statistics (MetaDetect), and even the score itself. The comparison with tit_i therefore does not show that FADE outperforms these methods. I would expect:

    • The actual MetaSeg/MetaDetect on models whose internals are accessible (e.g., Faster R-CNN, Mask R-CNN), which would also quantify the cost of model-agnosticism.
    • VLM-based post-hoc failure predictors such as ViLU (Lafon et al., 2025, cited in the paper). In particular, FADE only uses the CLIP image embedding of the crop and ignores the text embedding of the predicted class.
    • Standard recalibration of the raw score (temperature scaling, Platt, isotonic) and position-dependent calibration (Küppers et al., cited), which is close to the [ui,vi][u_i, v_i] configuration; model-specific estimators where available, e.g., SAM's IoU prediction head or UncertainSAM.
  • Training a separate meta-classifier for each model, dataset and task is a major limitation.

    • It requires labeled data from the target domain for every model. This conflicts with the zero-shot motivation for VFMs: with such data, one could adapt the VFM directly. The fish dataset has only 46 images, i.e., about 7 test images.
    • The common feature representation is the paper's main argument, but it is never exploited for generalization. There is no transfer across models, datasets or tasks, and no single meta-classifier shared by detection and segmentation, despite the "task-agnostic" claim. In the current design, transfer is not even possible: viv_i has the dimension of the dataset vocabulary, and the PCA is refit for each model–dataset pair with a different k, so pip_i lives in different spaces. This also weakens the claim that the estimates are "directly comparable across model families" (Fig. 9).
    • The meta-classifier is only evaluated on i.i.d. splits, whereas the paper is motivated by distribution shift. Cross-dataset experiments (e.g., train on COCO, test on VOC or Cityscapes) are needed.
  • Training objective and hyperparameters.

    • The loss is not specified (presumably binary cross-entropy on rir_i).
    • Binarizing at threshold \tau is the key design choice, yet it is set to 0.1 and never ablated. τ=0.1\tau = 0.1 is very lenient: errors become mostly hallucinations and misclassifications rather than localization errors. Moreover, without one-to-one matching, duplicates and fragments count as successes, so the definition of an error differs from the one underlying AP. Results for different τ\tau are needed.
      • More fundamentally, thresholding is unnecessary. One could regress the IoU directly, as in MetaSeg's meta-regression. Better still, one could predict a distribution over IoU (e.g., cross-entropy over discretized IoU bins, or a CRPS loss), which gives P(IoU > τ\tau) for any τ\tau at test time. Since the CRPS equals the Brier score integrated over all thresholds, it is a principled way to remove the dependence on \tau.
    • Other choices also need discussion: random oversampling without prior correction (which biases the predicted probabilities, see below), k tuned per model–dataset pair on validation AUROC, and checkpoint selection on an unspecified validation loss.
  • Experimental claims and findings.

    • Cost and robustness of the findings.

      • The method is presented as lightweight, but this holds only for the meta-classifier: CLIP feature extraction costs 200–310 ms per object, so FADE's overhead (9.54 s/image) exceeds the cost of the VFM itself (7.69 s/image, Table 14).
      • The 10 folds share a fixed test set, so the reported standard errors ignore test-sampling variance, and the domain-specific results rely on tiny test sets
      • Random oversampling makes the training distribution differ from the test distribution by a model-dependent factor. Its effect on both AUROC and ECE should be assessed, e.g., against class-weighted training with prior correction, or no rebalancing.
    • Comparing models with failure-prediction and UQ metrics, claimed as a contribution, is potentially misleading. The AUROC and ECE of the meta-classifier \phi characterize the pair (model, meta-classifier) on a model-specific prediction set. They do not measure the reliability of the base model itself.

      • AUROC ignores accuracy and depends on the model's error profile. Stronger models leave fewer and harder errors, possibly close to aleatoric uncertainty, while weaker models make gross errors that are easy to detect (cf. Jaeger et al., ICLR 2023). Appendix A.7 illustrates this: fine-tuning Grounding DINO raises AP (0.418 -> 0.525) while AUROC drops (0.853 -> 0.806).
      • Prediction sets differ across models: post-processing (top-k vs. score threshold), number of predictions, and positive rate, none of which are reported for COCO, VOC or Cityscapes. Each model thus defines a different failure-prediction task, and many easy low-score negatives inflate AUROC.
    • Calibration evaluation. The claim that VFMs are worse calibrated (ECE 0.034 vs. 0.017) is drawn from a score designed and tuned for failure prediction, not for calibration. Failure prediction (ranking errors below successes) and calibration are distinct, sometimes conflicting objectives (e.g., Zhu et al., ECCV 2022). Several choices explicitly favor discrimination over probability estimation: random oversampling without prior correction, and selection of the PCA dimension on validation AUROC. Differences in ECE therefore reflect how well a discrimination-tuned estimator happens to be calibrated, not the reliability of the underlying VFM.

Questions for authors

I find this work interesting and the problem well motivated. My main concerns are the baselines and the genericity of the approach. In the rebuttal, I would mainly expect:

  • Comparison with stronger baseline (see weaknesses)
  • Transfer: evidence, even preliminary, that a meta-classifier trained on one model or dataset transfers to another (e.g., across models on COCO, or from COCO to VOC/Cityscapes).
Reviewer_TGvbOpenReview ↗
Rating
2
Confidence
2
Informativeness
3
Presentation
3
Soundness
3
Read review
Paper summary

This paper introduces FADE, a post-hoc, model-agnostic framework for failure detection and uncertainty estimation of frozen vision models, covering both classical detectors/segmenters and modern Vision Foundation Models (VFMs), across semantic, instance, and panoptic segmentation as well as object detection.

Critical strengths
  1. A genuinely model- and task-agnostic formulation of prediction reliability. The paper's central design decision, decoupling prediction generation from prediction evaluation is clean and well-motivated.
  2. The fine-tuning analysis (A.7) strengthens the main claim.
  3. Strong improvement over the closest prior work: MetaSeg/MetaDetect.
Critical weaknesses
  1. The model only compare itself with raw confidence score predicted by the original models. The author do not compare with mainstream uncertainty estimation methods.
  2. Zero-shot performance are hard to evaluate. The model requier training on a certain dataset. However, there are no zero-shot evaluation about training on one dataset and evaluate on another dataset. It raises a doubt about zero-shot performance.
Questions for authors
  1. Can you compare the model with other uncertainty estimation methods including deep ensemble methods, MC Dropout methods, Conformal Prediction methods?
  2. Why the IoU threshold is set to a fixed number: 0.1? Can you provide some ablation studies on the differnet valude of IoU threshold.
  3. Can you provide some cross-dataset zero-shot experiments such as trained on COCO and evaluate on VOC?
Reviewer_s6MjOpenReview ↗
Rating
1
Confidence
3
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

The paper aims to tackle the reliability of classical and vision foundation models in image segmentation and object detection through efficient uncertainty estimation. To provide uncertainty, the paper trains a lightweight meta-classifier that takes in features (confidence, semantic features, task-specific features, geometric features) and predicts the probability score indicating the probability of success. The trained meta-classifier is model- and task-agnostic.

Critical strengths

The paper tackles the problem of reliability from uncertainty estimation.

Critical weaknesses
  • Motivation of the proposed work:

    • The proposed method to develop a model- and task-agnostic post-hoc uncertainty estimator is not well motivated. In what sense does this design outperform the design of using a post-hoc estimator per model and task?
    • How is the method grounded in uncertainty estimation principles? How can the predicted score be interpreted as uncertainty/confidence? The training looks like a heuristic way to estimate a score with some feature engineering of the predictions.
  • Reading/presentation issues:

    • In the sentences after moreover " and " till exhibit, the paper describes the discrepancy between foundation and classical models. First, it’s hard to understand whether this is an observation from the literature or their own experiments. Second, is there any proposed mechanism to solve this discrepancy in the paper? This should be clearly mentioned. Minor: "Our code is publicly available at TBA." If there is no link to share, it is suggested not to include the line at all.

    • It is unclear which datasets were used to train the meta-classifier.

  • Experiments: The comparison with existing baselines is non-existent. The paper has only compared with raw scores. However, post-hoc calibration is a long-standing field.

Questions for authors

Please refer to weakness section

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Discussion (0)

Sign in to comment.