- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces an explainability-based framework for assessing the reliability and effectiveness of uncertainty estimates produced by predictive models.
Critical strengths
- It provides a novel perspective on understanding the effectiveness of uncertainty estimation.
Critical weaknesses
-
Lack of clarity and readability. The paper is difficult to follow, particularly in its motivation, methodological analysis, and interpretation of the experimental results. The presentation should be more concise and logically structured to make the central arguments easier to understand.
-
Insufficient justification of the problem's significance. The practical relevance and scientific significance of the research question are not sufficiently established. It remains unclear why the observed divergence between predictive performance and downstream uncertainty estimation constitutes an important problem beyond the specific experimental settings considered.
-
Limited completeness and depth of the study. The current investigation appears insufficiently developed for publication. Although the paper provides empirical observations and diagnostic analyses, it lacks a sufficiently general theoretical explanation or actionable methodological insights to establish a substantial contribution.
-
Unclear conclusions and key takeaways. The main conclusions of the paper are not sufficiently clear. While the authors demonstrate that different uncertainty estimators respond differently to optimization-induced representation changes, it remains unclear what generalizable insights can be drawn from these findings and how they can guide the design, selection, or evaluation of uncertainty estimation methods.
Questions for authors
- Is this framework suitable for other uncertainty models, such as Bayesian models?
We thank the reviewer for the constructive feedback. We have revised the paper to clarify its research question, main finding, and practical significance.
1. Clarity and research focus. Our study is not an explainability framework or a proposal for improving SAM. We investigate how the discriminative effect of covariance weighting on OOD detection changes across training conditions. SAM provides a controlled training axis, while Mahalanobis distance allows us to isolate covariance weighting within each trained checkpoint.
2. Scientific significance. Section 4.1 identifies a training-dependent difference that is not apparent from comparing final Mahalanobis scores alone. On CIFAR-100, equal weighting favors large-radius SAM over SGD (0.9237 vs. 0.9098 AUROC), whereas inverse-covariance weighting reverses their relative performance (0.8787 vs. 0.9076). Thus, the same weighting intervention has substantially different discriminative effects across training conditions.
3. Depth of analysis. Section 4.2 examines how weighted score contributions accumulate. Under large-radius SAM, later inverse-weighted directions increase mean ID–OOD separation but increase variability faster as AUROC declines. A Gaussian reference calculation illustrates how this imbalance can arise. Section 4.3 then shows that mean separation and variability alone do not determine AUROC: after L2 normalization and covariance refitting, normalized SAM achieves higher AUROC than SGD despite lower standardized separation. We analyze the corresponding score-difference distributions and pairwise rankings.
4. Conclusions and practical implications. Experiments across training procedures, covariance regularization, OOD datasets, and ViT representations show that inverse weighting can be beneficial or detrimental depending on the setting. The practical implication is to evaluate covariance weighting together with the trained representation, rather than assuming that a scoring rule effective for one training condition will remain effective for another. When representative OOD evaluation data are available, comparing equal and inverse-covariance weighting within the same checkpoint provides a diagnostic of weighting-induced gains or losses.
Regarding Bayesian models, our intervention concerns feature-based detectors with fitted covariance statistics and does not directly extend to Bayesian posterior uncertainty. Investigating an analogous interaction in Bayesian uncertainty estimation would require a separate formulation and validation.