- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how features that can distinguish between ID and OOD samples may still fail to produce reliable OOD detection scores in language-model trajectories. The authors present two main observations: 1) differences in text length can lead to misleading OOD detection, and 2) trajectory features that support supervised classification can still produce poor distance-based OOD rankings. The authors explain this through differences in within-class dispersion, showing that OOD representations can have more distant centroids but tighter distributions. I have several concerns on the paper quality, novelty, methodology, and experiments, which I do not believe the paper currently meets the acceptance standard and it requires substantial revision.
Critical strengths
None
Critical weaknesses
-
The paper is very difficult to follow and understand, numerous metrics and technical terms are introduced without sufficient explanation and are used excessively throughout the paper. This makes it difficult to understand the overall research narrative and interpret the results. It is suggested for the authors to improve the manuscript without relying on purely AI-generated contents. The current quality of the manuscript clearly does not meet the standard for acceptance.
-
The main observation that discriminative features do not necessarily produce effective distance-based OOD scores is genuinely well established (as explored in the discussed related work papers). The paper does not clearly explain what new insights are gained beyond demonstrating this phenomenon on language model trajectories. Moreover, while the paper presents extensive experiments and analyses, many results repeatedly support a basic observation without providing more indepth insights.
-
The paper also remains unclear why language model trajectories are particularly important for studying this problem. For example, it is unclear why the particular trajectory features were selected, why these features are appropriate for investigating the proposed problem, or what makes language model trajectories a particularly meaningful setting for this analysis. The authors also do not convincingly demonstrate how the observed failure differs from similar issues in conventional feature-based OOD detection.
-
A large amount of essential method and experiments information is put in the appendix (e.g., definitions and extended experimental results). Given that the main paper has enough space available (main text is only 7 pages), it is difficult to understand why so much essential information is deferred to the appendix, which significantly affects the readability and self-containedness of the paper.
Questions for authors
Please see the weaknesses.