- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Distance-based OOD detection (e.g., Mahalanobis-family methods) almost exclusively uses penultimate-layer features, which are optimized for ID class discrimination and may suppress variations useful for detecting distribution shifts. This paper proposes LSF, which exploits complementary information from an intermediate layer to improve OOD separation.
Critical strengths
- Clean overall design: the layer-selection criterion is computable from ID data alone, requires no OOD data and introduces no layer-count hyperparameter; concatenation-based fusion naturally supports layers of unequal width, avoiding the restriction of X-Mahalanobis that additive fusion requires equal-dimensional features projected into a shared coordinate space.
- Minimal deployment overhead: only +3 KB memory and +0.0011 ms latency over single-layer Maha++, far below the multilayer baseline (X-Maha: 0.0464 ms), with better performance.
Critical weaknesses
- Evaluation-definition issue for covariate shift; the main gains may come from "low-level shift detection" rather than semantic uncertainty estimation. As the authors state in sec.4.1, ImageNet-C/R/V2/ES "retain the semantic classes of the ID data" (semantically ID), yet they are actually evaluated as OOD. This means the paper's main improvement (on covariate-shifted data) comes from rejecting more semantically unchanged same-class samples, which is not the OpenOOD setting. The slightly worse results on ImageNet-V2 (a freshly resampled, same-distribution test set) support this reading: no better performance when there is no low-level shift. The method's effectiveness likely stems from intermediate-layer features encoding priors on the background/low-level statistics of ID data, rather than achieving the semantic uncertainty estimation expected of OOD detection.
- Insufficient experiments on convolutional backbones: no ResNet; and if I read correctly, the full ConvNeXt-T results (Tables 11/12) are ImageNet-LT only, while under ImageNet-1K calibration ConvNeXt-T appears only in the Table 4 ablation — the results are incomplete. These should be supplemented.
- No mechanistic analysis of the source of the gains, nor of the advantage under LT calibration: as in Weakness 1, the gains concentrate on covariate shift/Textures with minimal semantic near-OOD gains, and the link between semantic shift and the intermediate-layer channel is not analyzed. Moreover, many experiments use ImageNet-LT calibration, yet the source of the method's advantage on such data is not analyzed either.
Questions for authors
- See Critical Weaknesses.
- Transparency of layer selection: which intermediate layer is actually selected (l*) for each backbone, and is it the same layer under ImageNet-1K vs. ImageNet-LT calibration? What mechanism governs this?
- KNN score inversion under LT calibration: in Table 8, KNN's Near-OOD AUROC is 38.16/40.83 (mean 48.63 on ConvNeXt-T, below 50 even for far-OOD), i.e., OOD samples receive higher ID scores. Negating the score restores AUROC > 50 — the information is present, the direction is wrong. Does this arise from the collapse of neighborhood sampling on the ID side (especially tail classes) for non-parametric density proxies under long-tailed calibration? This is quite interesting.
- Baseline reproduction details: please specify the exact hyperparameters and reproduction details of all compared methods.
2 comments
We thank all reviewers for their time and thoughtful feedback!
In response to Reviewer p9sx's latest comments, we have further revised Section 3.3 and Appendix A.1–A.3 to strengthen the theoretical connection between entropy-density drops and potential OOD sensitivity, focusing on spectral sensitivity and complementary information. All references in our responses are to the latest revised manuscript.
As the discussion period draws to a close, we would greatly appreciate any further comments or questions from the reviewers, particularly regarding whether our revisions have addressed their concerns.
We thank the reviewer. We clarify shift detection, add convolutional results, and extend long-tail analyses. All references below use the revised manuscript.
W1. Semantic OOD versus covariate-shifted ID. Section 4.1 (Experimental Setup) explicitly distinguishes near/far semantic OOD (unseen classes) from covariate shifts retaining ImageNet classes. ImageNet-C/R/ES assess appearance/domain changes; ImageNet-V2 is identified as a close-distribution resampling control, not treated as equivalent to severe corruption. Sections 4.2–4.3, Tables 1–3, report semantic and covariate-shifted groups separately. We do not claim that greater detection of fog, defocus, or exposure changes demonstrates greater semantic uncertainty detection. Such monitoring can instead inform adaptation or recalibration. Figure 1 and Appendix C.4, Figures 6–7, illustrate why intermediate representations may respond differently to semantic and appearance changes.
W2. Convolutional-backbone coverage. Appendix C.3.2, Tables 14–15, now reports ConvNeXt-T under ImageNet-1K calibration: versus penultimate Maha++, LSF-C lowers mean semantic-OOD FPR95 44.13% → 40.56% and covariate-shift FPR95 70.54% → 64.45%. ConvNeXt-T/ImageNet-LT is in Tables 12–13; Swin-T/ImageNet-LT is in Tables 16–17. Appendix C.3.4, Tables 18–19, adds ResNet-50 (
resnet50.tv2_in1k). With standard Mahalanobis, LSF-B lowers semantic/covariate FPR95 49.58/66.36% → 48.71/63.65% (AUROC 86.51/75.80% → 86.97/77.19%). With Maha++, LSF-C improves covariate FPR95 67.74% → 63.64% but worsens semantic FPR95 52.06% → 56.31%. The discussion in Appendix C.3.4 notes that the original Maha++ paper also found ResNet-50 sensitive to ℓ2 normalization; this is context, not proof of the cause of the fused result. We explicitly report this limitation.W3. Mechanism and long-tailed behavior. Section 3.3, Proposition 1(a), Eq. 11, decomposes the intermediate block's contribution to fixed-class expected Mahalanobis separation into residual mean and covariance effects; Proposition 1(b–c), Eqs. 12–13, gives a conditional spectral explanation of sensitivity and relates a consecutive entropy-density drop to a one-step threshold change under stated assumptions. Appendix A.2–A.4 gives proofs, conditional-KL examples, and favorable/unfavorable shifts. These results motivate, but do not guarantee, better FPR95. Section 4.4, Tables 4–6, studies selection, feature redundancy, and fusion under ImageNet-1K; Appendix C.6.1, Tables 25–27, adds candidate-layer sweeps, LT selection criteria, and LT redundancy. In Table 26, ViT-B/16 LSF-C (B4) lowers near/far/covariate FPR95 58.85/25.73/70.60% → 55.99/16.21/59.25% versus penultimate-only; ConvNeXt-T LSF-C (S1B0) records 64.21/26.84/66.30% versus 64.22/34.19/71.72%. Table 27 shows that adding a third layer raises mean FPR95 from 44.18% to 67.74%, alongside increased redundancy. This supports selective fusion, not a causal explanation of imbalance.
Q1. Which layers are selected under the two calibrations? The new Table 24 (Appendix C.6.1) answers this directly: ViT-B/16 B4; CLIP ViT-B/16 B6; Swin-T S2B0; ConvNeXt-T S1B0 under both ImageNet-1K and ImageNet-LT. Table 4 identifies ViT-B/16 and ConvNeXt-T selections for ImageNet-1K; Table 26 gives the LT comparison. This is empirical stability of the selected indices, not a claim that the covariance spectra are invariant to class frequencies. ResNet-50 is evaluated separately in Appendix C.3.4 and is not included in the four-backbone cross-calibration table.
Q2. KNN score inversion under ImageNet-LT. Appendix C.3.2 (KNN under long-tailed calibration) describes sparse tail-class neighborhoods and the change from k=1000 to dataset-scaled k=90; Appendix D (KNN) specifies the two calibration settings. The updated KNN results appear in Appendix C.1, Tables 7, 8 and 9, and for ConvNeXt-T in Tables 12–13. Our additional neighborhood-size sensitivity check finds mean semantic-OOD AUROC 42.70% at k=1000, 67.24% at k=90, and 80.88% at k=5, consistent with the reviewer's hypothesis. This separate sweep is not presented as a numbered table in the manuscript. It does not establish a unique cause of inversion.
Q3. Baseline reproducibility. Section 4.1 names the benchmark, fixed backbones, detector families, metrics, and ID-only protocol. Appendix D (Implementation Details) specifies baseline scoring formulas and settings, including KNN k=1000/90, NNGuide k=10, and RS-Maha's ID-only radial-exponent search. Appendix E (Reproduction Details) describes calibration, feature extraction, compute resources, and release materials; Table 32 maps model abbreviations to checkpoints. No baseline hyperparameter is tuned on OOD data or the ID test split.