- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper explores candidate definitions for measuring the “typicality” (as a proxy for quality) of an embedding, i.e., how difficult the corresponding input is for the model. Through a systematic comparison of supervised and unsupervised, global and local scores, across vision, language and multimodal settings, the authors identify angular density as the most consistent predictor of model quality among the candidates considered.
This geometric score outperforms supervised methods, with the benefit of working in cases where the notion of class or label isn’t available, but with the drawback of requiring enough statistical coverage of the latent space for meaningful inference.
They provide insightful links to known phenomena in latent geometry (e.g. neural collapse), as well as hypotheses on the mechanisms behind the emergence of the structure they leverage.
Critical strengths
S1 : Broad and systematic empirical evaluation. The paper evaluates a wide range of candidate geometric properties across vision, language, and multimodal representations. The comparisons span supervised and unsupervised measures, as well as global and local properties. They are not pushing for a method, they systematically compare many candidates and retain the best one. This makes the identification of angular density as a consistent predictor particularly convincing.
S2 : Clear problem formulation and positioning. The paper is well written and provides a clear overview of the problem and its relationship to existing work. It motivates the need for embedding-quality estimation in settings where label-based approaches are unavailable or unsuitable.
S3 : Useful methodological contribution. The introduction of the Property-Quality Correlation (PQC) metric provides a quantitative way to assess the relationship between geometric properties (e.g. angular density, distance to class centroid, etc …) and embedding quality (e.g. classification accuracy), accounting for both the strength and monotonicity of this relationship. This score is compared against more standard ones (e.g. Spearman’s or AUC). This score is not without degeneracies though, see W2.
S4 : Insights into representation geometry. The paper connects its findings to established phenomena such as neural collapse and explores possible explanations for the emergence of the geometric structure underlying angular density. These connections help situate the empirical results within a broader understanding of learned representations.
Critical weaknesses
W0 : Novelty. The authors cite Sun et al 2022 as a supervised metric requiring classes. This is not true. Sun et al.'s metric is exactly the same as the proposed one with the only difference being in the distance (euclidean for Sun and angular for this paper). The scope of both studies are related but different (detecting ood embeddings vs quantifying the quality of an embedding). I'd like the authors to give proper credit given how close these two works are.
W1 : Clarification on the notion of typicality. The abstract and introduction could better set the stage on typicality. I believe you are trying to say something like “we define typicality as …”, either with an abstract definition of which angular density is one operationalisation, or directly as angular density, and then mention that you also test other definitions but that angular density is the one you finally keep based on such and such analysis. Currently, the first mention of typicality is in the abstract : “We argue that angular density measures an embedding’s local typicality” (l16,17). At this point, this is either a definition of typicality, which is obscured by the use of “argue”, or a claim that angular density probes a notion of typicality yet to be defined. I believe you are in the former case, as I can’t find a definition of typicality that is not through a measure.
W2 : PQC degeneracies. PQC is well motivated but it looks hand crafted and has many very undesirable degeneracies. The most striking one is as follows. Take a property to be evaluated, and assume it almost exactly matches the quality you evaluate it with, say accuracy, except on a few number of points. Then , and goes down with the number of bins. The second most undesirable property is the sensitivity of this score to the number of bins, which you do not appear to test. I’d argue that you were trying to craft a distributional distance, which could replace PQC without the trivial degeneracies. See Q2 for more detail.
minor weakness :
- typo : figure 5 reports “knn accuracies” whereas I believe it should be “knn overlaps” in this context.
- “Wang & Isola (2020) [...] with subsequent work [...] Liu et al., 2018.” : the 2018 ref can’t be subsequent work of the 2020 one.
Questions for authors
Q1 : Missing property ? Related to W0, I was wondering if you had tested euclidean density, and compared it to angular density. I can’t find a mention to this in the paper or appendices. For example, one could take the mean squared distances to the kNN, instead of the mean cosine.
For normalised embeddings, the two are equivalent, as if and are unitary. In general though, it captures both the aspect of angle and norm, which you have separated in your study. Intuitively, this is the metric that makes the most sense, unless you argue (or show) that the norm information is unrelated to what you want to measure. In that case, discarding the norm is best. But from your own experiment, it seems that norm does carry some information.
Comparing to the distance to the kth NN in the main body (so Sun et al.) would strengthen the paper as it would be fully transparent and more anchored in the literature.
Q2 : Why PQC ? In the limitations, you mention that “Our per-bin PQC scores are moderate (0.2–0.6)”. I would argue that PQC is not very interpretable. There are many issues with PQC, e.g. the confound of whether the model is good at all. Due to the information term, a perfect model would give PQCs of . A mediocre model would have information terms relatively small. This is not exactly true though, since a good property would still categorize all successes in higher bins, so accuracy on D10 could significantly exceed the overall accuracy of the model. But the idea is there : you want the ranking given by to match the ranking given by . Here is the issue though.
A natural way to normalize PQC (or any other distance in general) would be to compare it to : the absolute ceiling of what you truly want to measure. This shows the second failure mode of PQC : if almost exactly matches , with the accuracy, the monotonicity term will be 0.1, meaning that PQC(q,q) = 0.1, even though there is a near perfect match between the property () and the quality (). You can achieve that with .
Therefore, I’d argue that PQC should be replaced by histogram (or distributional) distances, weighing each sample with , and comparing the two orderings given by and gives two histograms, which can be as fine as you desire, and with the same total mass, so you can normalize them into densities, yielding a normalised, interpretable score.
Q3 : In the LLM case, do you have any intuition as to why instruct models are seemingly less organised than base models ?
3 comments
The authors have successfully addressed my concerns.
- The novelty concern, which seems to be shared with reviewer xQSm. Better acknowledgement of existing work and positioning within the literature addresses address it.
- The rewording of the definition of typicality addresses the slight clarity issue.
- Additional discussion on PQC: I do not expect the authors to test every possible metric. I maintain that more grounded measures would significantly improve this paper, as also raised by reviewer xQSm. However, this choice, even if not perfect, is well motivated and provides interesting results. The proposed added discussion is sufficient.
While additional analysis (e.g., on the mechanisms driving angular density/clustering) would be a great addition to this work, it can remain as future work.
For this reason, I believe the paper makes a valuable contribution to the literature and should be accepted. I will raise my score accordingly.
Thank you for your follow-up and for raising your score. We are glad that our answers addressed your concerns!
Dear Reviewer,
Thank you for a thoughtful review that will help us improve our work.
W0 (novelty, Sun et al.). You are right that we described Sun et al. as requiring class labels, and it does not. We will correct this and credit it prominently. Sun et al. score a test input by the Euclidean distance to its k-th nearest neighbour among L2-normalized penultimate-layer features of the training set, for OOD detection. The score uses no labels at test time, although their encoder is trained with labels (cross-entropy or SupCon). They also ablate an averaged-k distance, which is the closest variant to ours, and report that it performs on par with the k-th-NN distance (their Figure 3d). Ours is the mean cosine similarity to k neighbours, computed on mean-centered embeddings, to predict per-input reliability within distribution and across paradigms. The two are close, and we will say so. We have not compared the two scores directly, and we will state this.
W1 (typicality). We will state in the abstract and introduction that typicality is defined operationally as local density in the encoder’s space. The introduction already says “an input is typical if its embedding lies in a region the encoder populates densely.” We will add that we compared several candidate properties and kept angular density based on the analyses in Section 4. We will also drop “argue”.
W2, Q2 (PQC degeneracies). PQC is hand-crafted, and it does have these problems. A property that nearly matches the quality has Information near 1, but its Monotonicity is lowered by small fluctuations among saturated bins and is bounded below only by 0.1, so PQC(q, q) falls well short of 1. We have not tested sensitivity to the number of bins, and we will say so. Two points of scope. Within one model, all properties are scored against the same quality q, so their ranking does not depend on how good the model is. Absolute PQC values across models should be compared cautiously, and we will say so in the text. Spearman and AUROC are per-sample and not sign-agnostic, so they do not rank all properties identically to PQC (Appendix, "Alternative Scorings"). We will add a subsection on these degeneracies, including the PQC of the oracle property as a ceiling. We will describe your histogram-distance proposal as a better-defined alternative that we have not evaluated. We do not know whether it would change the ranking, and we will not claim that it would not.
Minor. We will check the Figure 5 label (overlap vs. accuracy) and fix the sentence about Wang & Isola (2020) and Liu et al. (2018).
Q1 (Euclidean density). We have not tested this, and thank you for raising it. For unit-norm vectors the squared Euclidean distance is 2 - 2cos, so the mean squared distance to the same k neighbours is a monotone transform of our score. Without normalization, the Euclidean version mixes angle and norm. Sun et al. likewise find that feature normalization is critical for their score, which is consistent with our angle-only choice. We will state the equivalence and note that the unnormalized variant, the k-th-NN distance and the averaged-k distance are untested. Norm does carry some information, and we will present the angle-only score as one choice among several.
Q3 (instruct vs. base). We have no tested explanation. Instruct PQC is lower (mean 0.18 vs. 0.28). Our setup contains one confound: base models get 5 in-context examples and instruct models get none (Appendix, “LLM Quality Measure”), so the last-token activations come from different prompt formats. We will state this confound in the text. One possible account is that post-training reshapes late-layer geometry. We have not tested it, and we will label it speculation.