- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CLEAR, a post-hoc method for improving uncertainty estimation in Evidential Deep Learning (EDL) without retraining or changing the base model's predictions. The authors argue that evidential models may assign strong evidence to OOD or adversarial inputs even when their latent representations are not well supported by the learned distribution.
To address this issue, CLEAR 1) estimates class-conditional latent means and covariances using held-out calibration data, 2) generates multiple perturbed views directly in the latent space, and 3) computes a conflict score from the interactions between the whitened views. When the conflict score is high, CLEAR reduces the evidential strength to increase uncertainty while preserving the original prediction.
The authors evaluate CLEAR on classification, regression, and object detection benchmarks, comparing it against existing evidential and post-hoc uncertainty methods. The results show improvements in OOD and adversarial detection AUROC, particularly on challenging datasets such as ImageNet and CIFAR-10. The authors also report substantially lower inference overhead compared with existing post-hoc methods that require repeated model evaluations.
Critical strengths
-
Efficient post-hoc uncertainty adjustment: CLEAR improves uncertainty estimation without retraining the underlying evidential model or modifying its predictions. Since the perturbations are generated directly in latent space, the method avoids repeated full-network evaluations. This makes the method computationally efficient compared with existing post-hoc approaches such as S-EDL and C-EDL.
-
Strong OOD and adversarial detection performance across multiple tasks: The authors evaluate CLEAR on several classification and regression benchmarks, with additional experiments on object detection. Table 1 shows substantial improvements in adversarial detection AUROC, particularly on CIFAR-10 and ImageNet. These results suggest that the proposed method can provide useful separation between ID and unreliable inputs across different tasks.
Critical weaknesses
-
Unclear justification of the proposed latent conflict mechanism: The authors claim that CLEAR measures the disagreement between perturbed latent views. However, Equation (14) computes the products of squared coordinates across different views, which can produce a non-zero conflict score even when the two views are identical. Moreover, the perturbed views are not passed through the model again, so it is unclear whether the score actually measures local predictive disagreement or simply the distance from the calibrated latent geometry. The paper does not provide a direct comparison with simpler class-conditional distance measures, such as Mahalanobis distance, or a deterministic version of the conflict score without stochastic perturbations. Without these comparisons, it is difficult to determine whether the proposed conflict mechanism provides additional information beyond the underlying latent geometry.
-
Significant degradation in uncertainty calibration: Although CLEAR improves OOD and adversarial detection AUROC, the calibration metrics show substantial degradation. In Appendix C.2, Table 4, CLEAR increases ECE from 5.66% to 33.46% on CIFAR-10 and from 4.56% to 75.74% on ImageNet compared with EDL. The NLL also increases considerably, reaching 6.77 on ImageNet compared with 0.99 for EDL. Since the main objective of the paper is to improve reliable uncertainty estimation, such large calibration errors raise concerns about whether the method produces meaningful uncertainty estimates beyond separating ID and OOD samples. Preserving the predicted class does not necessarily mean that the resulting uncertainty is well calibrated.
Questions for authors
-
Clarification of the latent conflict mechanism: Equation (14) computes interactions between squared coordinates of different latent views, which can be non-zero even when the views are identical. Could the authors clarify how this score measures disagreement between views rather than simply capturing the magnitude of the whitened latent representation? In particular, how would CLEAR compare against a simpler class-conditional Mahalanobis distance or a deterministic version of the proposed score without perturbation sampling? This would help assess the necessity of the proposed conflict mechanism.
-
Clarification of the uncertainty calibration trade-off: Appendix C.2 reports substantial increases in ECE and NLL, particularly on CIFAR-10 and ImageNet. Could the authors clarify why these degradations are acceptable for reliable uncertainty estimation? Also, is it possible to retain the improvements in OOD and adversarial detection while maintaining reasonable calibration performance? This would help assess the practical usefulness of CLEAR.
-
Clarification of adversarial robustness: The paper evaluates CLEAR under several adversarial attacks, including PGD and AutoAttack. However, it is unclear whether these attacks explicitly target the adjusted uncertainty produced by CLEAR. Could the authors clarify whether an adaptive attacker minimizing the latent conflict score was considered? This would help assess whether the reported improvements persist against attacks targeting the uncertainty estimation mechanism itself.