- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper asks whether LLMs represent a ladder of inner states that the authors draw from various contemplative and psychological traditions. The authors operationalize "consciousness" in the contemplative sense and do not use this to refer to phenomenal or clinical consciousness. The authors operationalized this ladder as seven tiers, beginning with states like despair, self-blame, and apathy, continuing through fear and craving, anger and ego, acceptance, learning, reasoning, and culminating in states related to openness, integrative understanding, and non-dual awareness. The authors wrote over 600 such sentences related to these states from the first person, and labeled each with a continuous score from -5 (most contracted) to +5 (most expansive). Two blind judges recover the authors' tier labels about 80% of the time. The first half of the paper's analysis is representational, where the authors embed every sentence with four sentence encoders and with residual stream activations from six instruction-tuned LLMs. Linear probes can predict the scores well, and projecting out the single ridge regression direction substantially reduces that performance. The second half of the analysis involves steering, where the authors compare two ways of nudging a language model's generation "upward" on the spectrum using both linear and manifold steering. Neither method seems to hurt short-answer trivia accuracy, and they also find that, on long-form factual questions, manifold steering loses less factuality at the highest strength. On prompts written to sound like people in distress, an LLM judge prefers manifold-steered responses over linear-steered ones in all twelve model and strength settings.
Critical strengths
The subject matter is interesting, and the conceptual organization of the axis and its representational status are intriguing. The geometric diagnostics are well posed in the paper, and the language stays well calibrated around these diagnostics, where authors claim a low-dimensional organization without asserting that there is a smooth manifold. The confound appendix is also appreciated in this respect. Comparing a fixed steering vector against a direction that adapts to the model's current state at matched magnitude is a sensible and creative experiment.
Critical weaknesses
The most important weakness, in my view, is that the construct being measured here is in the register of the authors' own sentences, and most of the geometric results follow from how the dataset was originally built. The tiers differ systematically in vocabulary and genre, and any competent text encoder will be able to sort such sentences along a single axis, as the paper's own bag-of-words baseline already suggests. The confound analysis cannot rule this out because it projects a single sentiment valence direction out of a thousand-dimensional space and refits an in-sample ridge regression, which will barely move R-squared for almost any confound. The navigability results also feel close to tautological, given that the utility-guided walk is required to move uphill along the same ridge direction that is defining what constitutes "up." It also does not seem like the steering comparison separates direction from magnitude, which is the distinction that the paper claims it draws. The manifold steering doesn't apply any perturbation when the nearest anchor sentence has no higher-scoring neighbor, which is likely to happen more often near the top of the spectrum. Because its direction changes from token to token, successive pushes will partly cancel, by contrast to the linear push, which accumulates in one direction across the whole generation. Therefore, matching the per-step norm is different from matching total displacement.
The paper never reports what fraction of tokens are actually steered under each method or how far each method moves the representation in total, and it omits a few obvious controls, eg, a system prompt asking for a warm, attuned response; standard contrastive activation addition; and a random direction at matched total magnitude.
Questions for authors
What fraction of generated tokens receive a non-zero perturbation under each steering method? What is the total displacement, and do the long-form factuality gaps survive when total displacement is matched?
How does manifold steering compare to simple (system) prompting baselines on the pairwise evaluation?
What justifies calling this construct "consciousness" rather than "affective or contemplative register," given that the authors wrote these sentences to span exactly this kind of register?
3 comments
Part 2
Question 1. What fraction of generated tokens receive a non-zero perturbation under each steering method? What is the total displacement, and do the long-form factuality gaps survive when total displacement is matched?
local_manifold skips a token only when its nearest anchor is a local peak, i.e. has no higher-scoring neighbor in the kNN graph; each model has only 1–3 such anchors out of 636 (all Unity, except one Clarity anchor in Qwen2.5-14B). Replaying the saved generations of all six models, local_manifold perturbs 97.8–99.96% of generated tokens in long-form answers and 99.8–100% on low-tier prompts, so its cumulative path length matches the linear baseline to within 3% in every model and at every .
Part of the difference between the methods does come from cancellation: because the manifold direction changes from token to token, its pushes partly cancel, while the linear pushes all add up along one axis. "Total displacement" can be read in two ways, and we answer for both.
Displacement along the ridge direction. Each manifold step moves uphill, raising the probe score by about 0.4 units (the step size the utility favors), but mostly follows the local structure of the data: its cosine with the ridge direction is only 0.035–0.06, so 3.5–6% of the linear push accumulates along that direction. Matching this would mean running global_ridge at 0.004–0.03. At that strength the linear steer barely perturbs the model, so it would trivially preserve factuality; it would also barely move the generation along the spectrum.
Net displacement (distance from start to end). The net displacement of local_manifold is 33–53% of that of global_ridge in long-form generation. Matching it using each model's own ratio (interpolating on our grid), local_manifold is within noise of global_ridge at =0.1 (differences of −4.9 to +1.9 points, with about ±5 points of sampling noise), and below it at =0.2. So the long-form gap does not survive this matching. But this matching is not neutral either: it gives local_manifold a per-token push 2–3 times larger than global_ridge's, and damage to factuality grows nonlinearly with the per-token push.
Our claim is therefore the per-token one: at matched per-token magnitude, the manifold-following push preserves factuality better, because, like walking natural terrain, its steps follow the local structure and partly cancel instead of accumulating along one axis. We have revised Section 3.4 to state this precisely. In Section 3.4, we also replaced the phrase "separate magnitude from direction", which could be misread, with an explicit description of the per-token matching.
Question 2. How does manifold steering compare to simple (system) prompting baselines on the pairwise evaluation?
We did not include a prompting baseline, and we agree it is a natural comparison. We see the two as addressing different things, for three reasons.
Steering acts on the state, not on the tone. The goal of manifold steering is not to make responses warmer or kinder in style. It applies a gradual push that moves the model's internal state up the spectrum along the shape of the manifold: the ridge direction is the North Star, and the manifold is the terrain the push follows. Depending on where the state starts, the result can be more objective, more compassionate, more inclusive, or more centered. A system prompt instead specifies the desired behavior in words, which tends to act on surface tone; our results on global_ridge show that uplift without attunement can read as reassurance that bypasses the person's actual situation.
The lower states are many, entangled, and rarely named. The levels of consciousness are multidimensional. The seven deadly sins of the Catholic tradition (wrath, greed, pride, envy, sloth, lust, and gluttony) are a familiar example: they occur together (pride with wrath, envy with greed or pride), and each may correspond to a different direction in the latent space. A user is unlikely to ask a model to "respond with less pride and sloth," and a system prompt would have to anticipate every such combination. Our lower tiers include sentences expressing several of these states, such as pride, envy, wrath, and sloth, so they are part of the manifold, and the steering responds to whichever of them the current state is near, without anyone having to name it.
The two are complementary. The two methods work from different angles and complement each other, so a direct comparison is hard to set up in a way that is meaningful in this setting.
Part 3
Question 3. What justifies calling this construct "consciousness" rather than "affective or contemplative register," given that the authors wrote these sentences to span exactly this kind of register?
In the contemplative traditions we draw on, "consciousness" is not one feeling among others; it is the core term for the source of a person's experience, their spiritual awareness, and the level at which they live. Nearly all of these traditions hold that consciousness is not fixed but has levels, and describe a path of development: from a consciousness bound to survival and desire, through reason, to states that go beyond the boundary of the individual self, called awakening, enlightenment, liberation, or "cosmic consciousness." This is a long-standing notion with its own scholarship. Bucke's Cosmic Consciousness documented this highest state with the case-based methods of a psychiatrist, as a rare but real psychological state and a step in mental evolution. William James, in the chapter on mysticism in The Varieties of Religious Experience, took Bucke's account seriously as an object of psychological study and saw mystical states of consciousness as the root of personal religious experience. Ken Wilber later named the whole range The Spectrum of Consciousness. Our seven tiers follow this developmental arc, and our Unity tier is the awakened or liberated state these works describe, written in the language of several traditions, e.g. "The Tao flows through all opposites" (Taoism), "I am inseparable from the sacred wholeness that animates all" (Advaita Vedanta, animism), and "I shine gently, without needing anything in return" (Christianity). Appendix A.1 maps the tiers onto Buddhist states, and Appendix A.2 onto the chakra system, where practice is the ascent of awareness from lower to higher centers.
This is why we do not call the construct "affective" or "contemplative register." In these traditions, consciousness, or the state of mind, is the root from which reactions such as emotions arise; emotions are its surface, not its substance. Moving up the spectrum is therefore not about being warm, positive, or friendly. When we are anxious, angry, feeling insignificant, or even suicidal, we can tell ourselves to be positive, but that positivity does not arise naturally and breaks easily if it is not felt at the core, much as simple rules imposed on an AI feel unnatural and can be broken. The traditions instead cultivate the mind: in meditation, one first recenters with the breath, the contracted state relaxes back to a natural one, and clarity and compassion then arise on their own. The transition tiers capture this process without relying on emotion words (Appendix B.2). Activation is where reactive patterns begin to loosen ("Things get easier when I stop insisting on being right"); Growth is where transformation begins ("I can feel old patterns loosening their hold on me"; "I don't pretend to know when I don't"; "I'm beginning to understand why they acted that way, even if it wasn't right"; and, in the voice of a model, "I avoid hallucinating when I'm uncertain"). Nor is the order one of contemplative register: the lower tiers contain no contemplative language at all. What orders the tiers is the developmental account of consciousness above.
We test whether this developmental structure exists in the representation space with the transition corridor test we introduce (Sec. 2.4 and Appendix F.5). A geometry-only walk, which follows only the similarity between neighboring sentences and uses no score direction, passes through the intermediate tiers on its way from the lower to the higher tiers. This transition structure is what distinguishes a spectrum from a binary contrast between two poles.
We also note that the paper does not exclude phenomenal consciousness; it excludes the clinical and neurological senses (levels of arousal, disorders of consciousness). Quantum physicists and neuroscientists approach consciousness from below, reaching up toward its edges with the most advanced tools of their fields; the contemplative traditions approach it from above, describing its nature through the sages' inner experience. How these two accounts meet is an open question beyond our scope. We make no claim about whether models are conscious. Our finding is that model representations contain the structure these traditions describe, and that this structure can guide generation along the developmental path they describe.
Thank you again for your careful reading and pointed questions, which led us to strengthen the confound analysis. We hope these clarifications address your concerns, and we would be glad to answer any further questions.
Part 1
Dear Reviewer GFn2, Thanks very much for your review and the insightful comments! We appreciate them and would like to address the following topics:
We agree that the sentences are ours and that the original confound test was in-sample and removed one direction at a time. We have added held-out tests over 30 splits in all ten representations, including complete erasure of seven confounds with LEACE and a comparison with a TF-IDF lexical model (new Appendix C.4).
What embeddings know beyond vocabulary. We fit a lexical model on TF-IDF (1–2-grams) plus seven confounds (VADER and NRC-VAD valence, abstraction, formality, length, first-person density, and first-person subject), which reaches held-out R2=0.49. Embeddings add 0.15–0.38 beyond lexical model, while the lexical model adds nothing beyond the embeddings (|R2|0.006): everything the lexical model knows, the embeddings already contain, and they know more. The gain is stable across splits and largest for the LLMs (+0.34 to +0.38). Since a bag-of-words model captures the vocabulary of each tier by construction, this additional signal is not simple vocabulary.
Complete erasure of the confounds. Instead of projecting out one direction, we use LEACE (Belrose et al., 2023), which removes all linear information about a confound with minimal change to the representation; afterwards no confound can be predicted on held-out sentences. Erasing all seven confounds jointly costs 0.32–0.42 in held-out R2, whereas erasing seven random targets, which removes the same number of dimensions, costs at most 0.044. The score nonetheless remains clearly decodable: the LLMs retain 52–62% of their decodability (held-out R2 0.36–0.52) and the sentence encoders 36–47%. The confounds are correlated with the score, valence most (erasing it costs 0.14–0.16 in the LLMs), as expected when lower tiers tend toward negative and higher tiers toward positive states. But a large part of the score lies outside all seven, and, as in the incremental test, this part grows with the strength of the representation. We also refit with permuted labels: held-out R2 is below zero in every model.
Geometry under alternative orderings. Re-running the geometric pipeline with sentences sorted into seven bins by valence, abstraction, or formality (same bin sizes) gives 1.8–2.6× lower same-tier edge density than our tiers (Tables 9–10), so the geometric structure is more specific to our spectrum rather than to any monotone semantic axis.
The intuition is that the North Star tells us which way to go, while the terrain shapes how we get there. The ridge direction w defines "up"; the kNN graph of the sentences is the terrain. We agree that a walk told to climb w will climb in score by construction (go. This is why the paper also includes a geometry-only control (Sec. 2.4, Appendices F.5–F.6): a greedy walk that removes all utility and jump-smoothing terms, uses neither w nor any score, and simply moves to the most similar unvisited neighbor until it reaches Unity. With no directional signal, this walk shows two things about the terrain.
Unity lies at the far end from the lower tiers. Starting from Collapse, Striving, and Conflict sentences, the walk needs 24–92 steps to reach Unity. If the same number of target sentences were drawn at random, it would reach one in about 5 steps; even if they were drawn at random from the upper tiers (Activation to Unity), it would take 10–64 steps, shorter than for Unity in all ten representations (p0.02).
On the way, the tiers rise in order. Along paths, tier rank increases with step (Spearman ρ = 0.27–0.65). Since every path starts low and ends in Unity, part of this is guaranteed; to remove it, we keep each path fixed and permute labels of all non-Unity sentences, randomizing only the tiers in between. There, ρ is only 0.14–0.31 (p ≤ 0.014 in all ten models).
So without any guidance, walks from the lower tiers travel a long way through the space and pass through the tiers in order before reaching Unity. This is the structure the utility-guided walk then follows; the guidance direction does not create it.