- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work introduces the class-wise prototypes for Out-Of-Distribution (OOD) detection. The key is to create multiple prototypes per class, as multiple prototypes can capture different within-class regions (lines 053-055). The authors propose a post-hoc OOD detection method named CPD with simple techniques: spherical k-means is applied to normalized features per class. The writing is actually not very qualified, and empirical results are not satisfying.
Critical strengths
- The technique of the proposed CPD detection method is simple, straightforward, and intuitive, which should be appreciated.
- The computational cost of CPD is significantly less than that of the nearest-neighbor-based detection method.
- Experiments on the large-scale ImageNet-1K dataset are executed.
Critical weaknesses
One critical weakness is the inadequate writing. In the Abstract, the authors mainly focus on the technical advantage of CPD in computational cost, but do not even devote a single sentence to the rationale of how CPD promotes the separability between In-Distribution (ID) data and OOD data. In the Introduction, the authors only mention that “multiple prototypes can capture different within-class regions” (line 055) but do not provide any justification. In short, throughout the paper, the rationale behind CPD for OOD detection is not sufficiently justified.
Another critical weakness lies in experiments. As shown in Tables 1 and 2, the proposed CPD actually does not outperform OODD. The detection performance of CPD is not satisfactory. Moreover, the compared baselines are limited. NNGuide [a] is an enhanced version of KNN but is not included in the comparisons. KPCA [b] also addresses the heavy computational cost of KNN but is also missing from the comparisons.
[a] Nearest Neighbor Guidance for Out-of-Distribution Detection. ICCV 2023.
[b] Kernel PCA for Out-of-Distribution Detection. NeurIPS 2024.
Questions for authors
-
The authors should provide sufficiently convincing justifications for the rationale of CPD for OOD detection, and accordingly significantly revise the paper.
-
The detection performance of CPD shows no advantages compared to OODD, and more relevant baselines should be included and compared.