- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper shows that even pretrained representations remain under-adapted for open-set recognition. The authors propose HEAda, a lightweight nonlinear projection head that combines classification and metric-learning objectives to adapt the embedding space. Extensive experiments demonstrate consistent improvements across various encoders, datasets, and OSR methods, and show that simple KNN and Mahalanobis scores can outperform more sophisticated detectors after proper representation adaptation.
Critical strengths
The strengths of this paper are clear. (1) It achieves effective improvements in open-set recognition with large pretrained models through a combination of two existing losses, and the resulting representation improvements are consistently beneficial across a wide range of OSR methods. (2) The experimental results are convincing, and the findings provide useful insights for future OSR research, particularly for practical applications. (3) The experiments and the analyses based on them are quite comprehensive.
Critical weaknesses
The weaknesses of this paper are also clear. (1) Although the proposed method and experimental analysis are useful, most of the results are not particularly surprising. Fine-tuning a large pretrained model to obtain more compact representations is a relatively straightforward idea, and most of the experimental findings are largely consistent with expectations. (2) The proposed method is essentially a brute-force combination of existing techniques, with limited methodological novelty. (3) The results could serve as a useful new baseline for future OSR research, but they provide limited academic inspiration for future work, since learning more compact representations is already a common and well-established idea in the field, while the novelty of the proposed method itself is relatively limited.
Questions for authors
-
The choice of loss functions appears somewhat ad hoc, particularly the motivation for using the long-tailed loss. I suggest that the authors clearly explain the rationale for this choice at the first point where the loss is introduced.
-
The description of the proposed method in the abstract and introduction is very limited. After reading these sections, it is still difficult for the reader to understand what the proposed approach actually does. I suggest providing a clearer and more informative overview of the method in the abstract and introduction.
-
I believe this work has both significant strengths and weaknesses. Although I like this paper, my Weak Reject recommendation is mainly based on its limited novelty. However, I leave the final decision to the AC, as I am not fully certain about ICLR’s criteria for evaluating the level of contribution.