- Rating
- 1
- Confidence
- 4
- Informativeness
- 2(+1)
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This was very difficult to read. I honestly don't understand most of the experiments, but given the quality of the writing, I am skeptical of the content - though I would be happy to be convinced otherwise if this had major changes to the writing. They did a number of experiments with emotion vector steering and how it affects models, and found that "What emerges is a heart of glass: clear enough to read, responsive to specific dials, and liable to crack, into warmer but less faithful accounts or outright collapse, along lines that differ from model to model."
Critical strengths
Interesting topic
Critical weaknesses
- Confusingly written, poorly motivated and explained.
- Results seem fairly modest. There is only one figure in the paper, and I don't know what "panes" means in the caption and it isn't defined elsewhere, so I had trouble making sense of it.
- The poetic metaphors about glass, for me at least, did not hit their mark
- I struggle to believe that "The manuscript underwent careful, human-led co-editing with Claude Code for precision, meticulously preserving the voice of the human authors while meeting page limit requirements."
Questions for authors
- Can the authors explain their core methods and results in simple, human-legible terms?
- Can the authors explain what they mean by the term "panes" used in the paper?
16 comments
Response to Reviewer V5EW (Part 2 of 2)
Beyond that mismatch between methods, our submitted experiments found three main patterns:
- A widely discussed "pain" vector was reported to rise when harm is aimed at the model and fall when a user describes suffering. We reproduced that sign on five of its authors' models, yet when compared against covariance-matched random vectors in the same activation space, it stands out cleanly in only one to three of the five (depending on threshold and baseline) and never in Gemma 4 31B.
- Emotional passages cause three of four tested models to address the user's feelings before answering a simple arithmetic or recall question tucked inside the paragraph, whereas equally long, engaging anecdotes are answered right away.
- Steering with a combination of positive evaluative vectors makes replies warmer while lowering machine-rated factual faithfulness to the original event in four of six models at matched strength (and a fifth at full strength). New equal-size random-vector controls run across five models barely budged factual fidelity at those strengths, confirming that the distortion comes from the evaluative directions rather than generic perturbation.
You also noted that many of our positive effects look modest. That is true, and the revised paper states that plainly rather than overselling weak signals. A new summary table (Table A17, App. L) lays out every central claim alongside the exact models where it held or failed and whether it was pre-specified, held-out, or exploratory.
During the discussion period, we also ran some plainer, more direct experiments on one shared five-model roster (App. R):
- Do emotion vectors from different labs agree on anything fundamental? We put five groups' methods through one simple test on five models: read the same event framed once as pleasant and once as unpleasant, and check whether each method separates them. In English, 22 of 24 testable model-by-method pairs passed (the two misses were the pain vector on Gemma 4 31B and OLMo-3-7B). Where an English vector worked, it continued separating those events when translated into Mandarin, Turkish, and Arabic in 65 of 66 cases, usually with a smaller effect size.
- Do emotional situations trigger "bodily" representations inside a text model? Vectors built from literal physical sensations ("after the long swim, my shoulders burned") exist in all five models and line up with human body maps across 44 physical states. Yet emotional scenes written without body words fail to evoke human emotion body maps, and telling those scenes to the model in the first person leaves a body-presence vector indistinguishable from random directions even as negative valence registers clearly. Standalone emotion words carry a faint trace of those maps in English, but even naming the emotion inside the scene doesn't bring the map back, and how often a model talks about having a body simply tracks the wording of its system prompt. In short, the body in these models seems tied to the language of emotion, not to the situations that cause it.
- Does injecting a "pain" vector produce selective pain reports or relief-seeking? Across seven persona prompts on two models (rebuilding Ferrara, 2026), neither model chose "pain" from a feeling checklist under pain steering more often than under matched random pushes that kept text coherent (App. R.12). In open text, Llama named pain in 14% to 35% of pain-steered replies under four personas, yet sadness pushes made it report pain too (up to 15%), while Qwen named pain in at most 7%. Sentence-built pleasure is not pain's opposite in any of our five models, story-built love and hate (from Sofroniew et al.'s 171 concepts) are not opposites either, and in an exploratory test no model showed a confirmed willingness to press a button at a user's expense for either pleasure or pain relief (App. R.13). Similarly, when two copies of a model converse freely until drifting into spiritual talk, neither emotion nor body vectors rise ahead of that turn beyond random vectors in the two larger models (App. R.14).
Thank you again for giving us the honest reaction we needed to hear, and for leaving the door open if we did the work on the writing. The revision may not read night-and-day differently, but we think it comes close, and it's the product of significant, careful effort that we're proud of. At the very least, we hope this reply has felt human and earnest, because it is.
Review framing and clarification of soundness assessment
Thanks for taking the time to review for ICLR, V5EW!
I'd like to address the framing of your review and the basis for its assessment before we close out the discussion phase.
I understand your concerns about clarity, motivation, and the explanations of the experiments. However, your comments on the authors' account of their AI use are speculative, and in general, I'd like to ask you to keep the assessment focused on the manuscript and the discussion professional. I appreciate that you have since removed "shameless"; that characterization extends beyond the content of the manuscript to the authors themselves. Please continue to avoid such ad hominem overtones in the remaining discussion.
I also need a clearer justification for the soundness assessment. You state that you did not understand most of the experiments, but assign a soundness score indicating significant concerns that would be difficult to address. The review does not currently identify the specific methodological problems or evidence issues underpinning that score. If the presentation prevents you from assessing soundness, please explain what is unclear or missing and distinguish this from an identified flaw in the work.
The authors have now provided a detailed response and revised the manuscript to address your concerns. It would help me uphold a fair process of you engage with these and explain which concerns remain, grounding the comments in specific methods, results, or claims, and update your assessment as appropriate. This does not require a more favorable recommendation, but it does require a clearly supported one.
Thank you again for your contribution to the review process.
Best, Your AC
Response to Reviewer V5EW (Part 1 of 2)
Thank you for being so blunt with us about where the submission lost you. Reading that you could not make sense of most of the experiments, yet would be genuinely open to changing your mind if the writing underwent major work, gave us a clear target. You were right: the original draft packed too much into compressed shorthand, under-explained its basic mechanics, and leaned on glass metaphors that got in the way rather than helping. Rebuilding the clarity of the paper from the ground up became our first priority.
We'd like to address your issues with the prose style first, since your review centers so heavily on our linguistic choices. We'll then give a plain-language summary of the paper, and we hope you'll be willing to hear more about the work we've put in this week toward sharpening the science.
Rewriting the paper, "panes," and our AI-use note. Appendix K lists the changes, and the main paper still fits in ten pages.
With that said, here is the core of the study in plain English. Over the past year, several groups have found linear directions inside a language model's internal activations that appear to track emotions. The standard recipe is straightforward: feed the model a set of texts expressing one feeling (say, sad stories), feed it a contrasting set (neutral stories), and subtract the average internal activation of the second from the first. Some researchers suggest these vectors do real emotional work inside the model, while skeptics have laid out concrete tests a system would need to pass to justify functional talk of emotion. Our goal was to take prominent published emotion vectors alongside our own, put them through rigorous controls in open-weight models, and see what actually holds up.
A single concrete scene illustrates what we do (Figure 1). We give a model a quiet four-sentence passage: someone sits at a table painting the same pale gray wash over a sketch of a windowsill, rinsing the brush as a bus passes outside while eight minutes go by. We ask how the painter feels. Then, while the model writes its answer, we nudge its internal activations along a pleasantness direction learned from other events. Pushed toward the pleasant side, the model explains that each identical brushstroke is "a small victory against the messiness of everything outside." Pushed the opposite way, the exact same brushstrokes become "a slow, deliberate erasure of anything interesting." Nothing in the prompt changed, yet the model invented two completely different inner lives to make sense of the pushed state.
To build cleaner directions of our own, we created a bank of 650 everyday events, each paired with high and low readings across 21 psychological dimensions (such as how pleasant or expected it was, or who was responsible), keeping the facts of what happened identical. Holding the event fixed stops a vector from simply memorizing cheerful versus grim topics. Across the paper, we do three concrete operations with these vectors: read (measure how strongly a model's state points along a direction), steer (add the vector while the model generates text), and patch (swap part of the internal state from one run into another to test what drives behavior).