- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper hypothesizes that the geometric structures empirically found in word embeddings and model activations among e.g. months, chords, and celestial bodies, result from symmetries in word co-occurrence statistics. The paper formalizes the structures assumed in each of the three examples using one unified construct via groups and representation matrices. The proposed construct explains and predicts the geometry of embeddings from primarily only symmetry relations, which is a compact property of the word co-occurrence matrix. The predicted embeddings are then compared with previous approximations from related work and yield good alignment.
Critical strengths
Although the intuition and related theories behind each of the three examples (month, chord, sky sphere) as to why the embeddings form shapes have been well established, this paper is the first to use one simple theory to explain all three. The theory involves a minimal number of constructions while being general enough to express different symmetries and directly compute the predicted shape for embeddings.
Critical weaknesses
Karkada et al. (2025) approximates real embeddings using an idealized model. The current paper approximates that idealized model using a simple, general, low-parameter model leveraging symmetry structures. This offers nontrivial math insight into the models proposed by Karkada et al. (2025), but for the sake of explaining training phenomena, this two-hop interpretation offers limited insight. All embeddings in this paper are from eigendecomposing M* (L179). No analysis used any embeddings trained from corpus. At least some experiments comparing theory with real embeddings are necessary to tie the results to real dynamics. For the same reason, the current "Empirical" labels in figures are potentially misleading, and "learned word embeddings" in the abstract are in fact "idealized word embeddings".
Questions for authors
- Why does no experiment compare prediction with trained embeddings? Will the authors replace the "empirical" datapoints with trained embeddings?
- Which section explains why the theory predicts the circle of fifths instead of other permutations that follow T/I, e.g. a "circle of fourths"? If their distinction comes from non-symmetry statistics, then the claims in L029 and L080 are too strong.
- Abstract clarity. Currently, the full text, or even the beginning of Introduction, is much more readable than the abstract. Consider a longer, more self-contained abstract that is written as friendly as the full text.
- Previous work explains embedding geometry from co-occurrence. Intuitively, co-occurrence and embedding geometry should have a common cause in the language. This paper uses symmetry assumptions about co-occurrence to predict the embeddings. This may be claimed to be structurally a step closer to modeling the common cause. The validity of this claim depends on whether co-occurrence is a bottleneck for those word embeddings and model activations considered here.
- ChordBERT results and figure: Since we are using Gram matrix as a proxy for M*, what exactly does the figure show? Why is it not a test of circular logic, especially when layer 3 has high isotypic energy?
- L193: I could not understand "Abusing notation ...". It's otherwise acceptable except C is used later. The definition of C should be proper.
- At first I could not understand why "sphere" was related to celestial bodies. Consider replacing "sphere" with "sky sphere" in "Celestial objects reside on a sphere inside a LLM’s residual stream" for clarity. A similar edit should benefit the abstract too.
- Fig 3: Consider maybe using colored text labels for matching labels to points. Coloring might work less well for Fig 2 though.
- L1293: "Fig 4 B" should be "Fig 3 B".