- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper concerns previous findings in interpretability literature about cyclic concepts. Unlike ordinary concepts, which can usually be represented well as a vector, certain concepts such as days of the week or months of the year are usually placed on a circle. The authors claim that the tests that underlie this judgment may not be enough to make this claim. They apply three measures of circularity and find that they do not properly distinguish linear from ordered concepts, although days and months still show some evidence of being genuinely cyclic representations.
Critical strengths
The paper conducts relatively careful experimentation and identifies a weakness in existing tests for circular representations in that an ordered list can produce several signals that appear circular. The authors experiment with several criteria and model families, and the documentation of experiments is relatively thorough.
Critical weaknesses
This paper is difficult to read and the general writing style seems heavily affected by claudisms. For instance, I have never heard anyone refer to this property as “circulance” though if the authors can point me to some recent works that use this terminology I can update my beliefs. The manuscript is extremely long-winded, yet it is never really motivated why we should care about the experiments presented here. The authors are encouraged to properly motivate their work in the text and to clean up overly-dense language.
My larger concern is the significance of this paper. Cyclic concepts are already a fairly specialized case in interpretability, and the paper does not make clear what changes if a representation passes this test or does not pass this. Does the result help explain a model’s computations, predict its behavior, or improve an interpretability method beyond making claims of circularity more precise? The two canonical examples, days and months, still pass, so the main finding is not as surprising as it seems either. The failures for other concepts are interesting, but what do we learn from this as a field? I would encourage the authors to shorten the presentation and make the broader consequences more explicit.
Questions for authors
N/A
4 comments
Reply to Reviewer spAa (2/2)
W5: Days and months pass, so the result is not surprising
What is new is that the earlier evidence could not have shown it. Before this work, the claim that days and months are circles rested on tests that an ordering also passes. A fitted successor map has its eigenvalues at the roots of unity even for random nouns, the fundamental share ranks months above ordinals in only 2 of the 9 models, and the wrap gap passes temperature scales. On that evidence the claim was untested. We test it with a measure that orderings fail, against seven matched controls in nine models, and with the noise-invariant measure all 81 Holm-corrected tests pass.
The test could have failed for days and months, and it does not give a clear pass for several other concepts that were expected to be circular. Clock hours, which most readers would expect to form a cycle, are only borderline. The day of the month inside a date behaves as an ordering, although calendars repeat. Compass directions are organized by direction type, and seasons do not form a cycle. A test that gives these answers is informative when it says that days and months are closed.
The result also says where the cycle is held. Days and months are closed at the token that names them; at the end of the sentence they remain more circulant than number words and ordinals but no longer separate from the graded scales. This agrees with the finding of Feucht et al. (2026) that Llama keeps the circle at the concept token but not where it computes the answer. The month cycle persists inside a date such as "10 January". These are new facts about the cycle, and the earlier tests could not reveal them because they also pass for orderings.
W6: What the failures teach
A recurring question in representation learning is whether a model trained on language inherits the symmetries of the world it describes (Karkada et al., 2026; Du et al., 2026). Our results show that the answer depends on the concept. Days, months, clock hours, compass directions, seasons and the day of the month all repeat in the world, but the test finds a closed ring only for days and months. Clock hours are borderline, the day of the month inside a date is an ordering, and compass directions and seasons have no more energy in the fundamental mode than random points. So a symmetry of the data does not guarantee the same symmetry in the representation, and the Gram matrix can test which symmetries a model has learned. A method that assumes a ring for every periodic concept will go wrong for some of them, and the test identifies which ones. The revised introduction makes this point.
We hope the revised text and these answers resolve the concerns about presentation and significance, and we can clarify anything further during the discussion.
Thank you again for your time and for the detailed review you provided on our paper. As the discussion period is ongoing, we wanted to check in and see if you have any follow-up questions or if there is any part of our response we could clarify further for you. We are ready to provide any additional information that might be helpful.
We thank Reviewer spAa again for the detailed review. We understand this is a very busy period, and we apologize for following up again. As the discussion period closes in less than one day, we briefly summarize again how the revision addresses the two main concerns. On presentation, Sections 3 and 4 were rewritten so that each paragraph opens with its point, the other main sections were revised in plainer language, and Section 6 moved to the appendix. On significance, the introduction now names the interpretability methods that assume a fitted curve closes (Engels et al., 2025; Wurgaft et al., 2026; Bhalla et al., 2026) and explains how they go wrong for a concept that is only ordered. It also connects the test to a recurring question in representation learning, whether a model inherits the symmetries of the world it describes, which our results answer differently for different concepts. We would be grateful for the reviewer’s feedback on whether these changes address the concerns.
Reply to Reviewer spAa (1/2)
We thank Reviewer spAa for the review. We appreciate that the reviewer found the experiments careful and the documentation thorough, that the paper identifies a weakness in the tests used for circular representations, and that the reviewer had no substantive concerns about soundness. Following the reviewer's comments, the revision rewrites the main sections in plainer language and adds a paragraph on why the question matters. Under W4 to W6 below, we explain in more detail what the results change for interpretability.
W1: Readability
We rewrote Sections 3 and 4. Each paragraph now opens with what its result means, and the numbers follow as evidence. We also rewrote the abstract, the introduction, the setup in Section 2, the behavioral results in Section 5, the related work, and the Discussion in plainer language. The introduction explains why the question matters before it turns to methods. Section 6, which two reviewers found disconnected from the rest, moved to the appendix, which shortens the main text.
W2: The term "circulance"
A circulant matrix is one in which each row is the previous row shifted by one place. Circulant matrices have long been studied in linear algebra, they are diagonalized by the discrete Fourier transform (Gray, 2005), and the circulant matrix closest to a given matrix in Frobenius norm is found by averaging each wrapped diagonal (Chan, 1988). Our ν is the relative distance from the Gram matrix to that closest circulant matrix. Du et al. (2026) measure the same quantity for weekdays in four language models and call it the circulant distance (δcirc). We called it non-circulance because ν is zero exactly when the Gram matrix is circulant and grows as the matrix departs from that form. The revised text gives both references where ν is defined, and we can adopt the name circulant distance throughout the final version if the reviewer prefers.
W3: Motivation
Circular geometry is now used in interpretability methods, and those methods assume that the curve closes. Engels et al. intervene on circular day and month features. Wurgaft et al. (2026) steer models along curves fitted through such features, and Bhalla et al. (2026) ask whether sparse autoencoders recover them. Each of these uses takes the fitted curve to be the concept, so that moving along it changes the concept and one full turn brings it back to the start.
If the states are only ordered, a closed curve through them still exists, but its last segment joins the two ends of a scale. In our data, the two extremes of the temperature scale lie close together in the representation, so the scale passes the wrap-gap test, and a ring fitted through it would treat "scorching" and "freezing" as neighbors, although the scale has no step between them. Moving along that segment changes nothing the model represents. Clock hours show the same risk from the other side: a Fourier test ranks them as the most circular concept in our data, so a researcher choosing a concept for ring steering on that evidence could pick them, yet our test finds them only borderline.
Several recent accounts derive circular geometry from the statistics of language (Karkada et al., 2026; Modell et al., 2025; Du et al., 2026), and a test of closure is what such predictions can be checked against. The test is also cheap to apply, since it needs only the Gram matrix of the states and a few ordered control sets of the same length, which any study of a cyclic concept can add. The introduction now makes this case before the paper turns to methods.
W4: What changes if a representation passes or fails
The first change is in what counts as evidence. The signals behind circle claims are produced by orderings and even by random nouns: a fitted successor map has its spectrum at the roots of unity for random nouns, and held-out successor fits reach R2 of 0.75 to 0.96 for them. A claim that rests on these signals alone says nothing about closure, and our test is built so that orderings fail it.
The test also agrees with behavior in one case. It found that compass directions form two interleaved four-cycles, and in completion prompts Llama's errors match that structure, since it keeps the starting type on 97 to 100% of 45-degree steps and never answers one correctly. This link is correlational, and the paper says so.
For computation, passing the test does not mean that a model computes on the circle. The wrap-around penalty differs between models and prompt formats, which fits the base-10 mechanism that Feucht et al. (2026) found in Llama. Du et al. (2026) predict circulant geometry from symmetry in the training targets, and our controls and decision rule turn their measure into a test that can confirm or reject such predictions.