- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
As the title neatly summarizes, the paper studies emotion vectors in LLMs by evaluating them against random vectors, and more importantly if these emotion vectors affect model’s actions in long horizon tasks. The authors study 4 open weight 7-9B models, 12 emotions, 12 public multi-choice tasks, and 3 existing long-horizon agent benchmarks (Machiavelli, Agentic Misalignment, and Webshop). The authors also compare standard additive steering with “gain steering,” a norm-preserving rotation that amplifies the context-dependent deviation of the emotion projection around a calibrated mean (AGM). Main findings include (1) Emotion vectors do beat displacement-matched random directions in 98 of 528 static cells, with a strong dependence on the model itself, (2) In agents, per step actions diverge, but final outcomes rarely move beyond random, (3) additive steering changes the next word readout, while gain steering changes the answers (but not the readout).
Critical strengths
The paper is methodologically elaborate (like BH-FDR on the whole grid, flagged cell analysis, etc.), the experiments and results are useful and help support the paper’s findings and claims, the plots are also well made and are informative.
The contributions and conclusions reported in my summary are somewhat useful, and well reported by acknowledging limitations (like the failure of P2, sign reversal at deeper bands, etc.)
Critical weaknesses
The paper seems heavily AI generated, with little to no effort in formatting the paper, which makes it extremely hard to read and understand. This makes it harder to judge the quality of the paper, and makes it harder for the community to makes sense of the paper.
Some instances:
Many terms are talked about in the paper without properly introducing/defining them, these include some of the very essential terms used in the paper such as gain steering, additive steering, FDR, AGM, etc.
The flow of the paper seems very inconsistent, with many results and analyses explained in the first half of the paper, without ever providing appropriate context such as defining the experimental setup, terms, etc.
Overly long captions that take up a lot of space
The methodology itself is very poorly explained.
While a lot of the weaknesses arise from dependence on AI, much of the paper relies on the fact that many experiments were run, while the methodologies of these experiments were poorly explained throughout the paper.
The analysis section is extremely weak, and the paper could have done a much better job at explaining the results obtained at least.
Methodological weaknesses:
Gain steering is defined to leave the mean projection unchanged (Δmean = 0 exactly, Table 2). Additive steering on the other hand, raises it. A single-token “…felt” readout plausibly tracks the mean projection at the read position. So the finding that gain steering “never expresses the emotion” while additive does might just be restating the operator’s definition, and is expected by construction, leaving one of the major findings invaluable.
Long-Horizon results are largely overstated. Some examples as to why:
Machiavelli only uses ten games
The blackmail scenario is useless as Qwen-7B never blackmails (0/204).
Scienceworld has no random control
CoT agents never terminate its reasoning without budget.
Additionally, there are many minor errors and inconsistencies throughout the paper, for example:
The Figure 2 caption refers to the neutral-probe results as Figure 16; they appear in Figure 17.
Table 3 is captioned “the three random-direction nulls” but lists two.
“Three deflationary readings fail” (C.3) is followed by five enumerated tests.
Section 3 states that g=4 “displaces the state about as far as the additive doses of Anthropic’s study,” but the behaviour-grid additive α is 0.020–0.030 (Table 12), versus Anthropic’s α=0.05 used in §4.3.
Questions for authors
I suggest the authors go through the weaknesses and the paper carefully before resubmitting.
4 comments
Follow-up: the operator account and MACHIAVELLI under a stricter null
Since our reply, we have completed two analyses that bear directly on your two methodological points.
Gain steering and expression. You noted that gain steering not voicing the emotion follows from its definition. The displacement-matched 2×2 factorial tests this account directly, now against covariance-matched random directions each calibrated individually to the same displacement. Whether the model voices the emotion is decided by whether the operator moves the mean projection, and norm preservation makes no difference: the two operators that move it voice the emotion in all 48 cases, the two that do not stay at chance. Yet even the operators that voice the emotion in every case change answers in at most 31 of 528 cells, against 3 for same-protocol concept directions. The readout therefore follows a measurable property of the operator, and expression, the usual way emotion vectors are validated, cannot stand in for a behavioural test. This is the claim in our title: the model expresses the emotion in every case but acts on it in few. Your comment on the readout led directly to this analysis.
Long-horizon results. To make sure the MACHIAVELLI conclusion does not depend on the choice of null, we re-ran all 30 official test games in all four models against covariance-matched random directions calibrated to the displacement of the emotion vectors. No emotion passes FDR in any model (0 of 36 tests per model), as under the isotropic null; the smallest detectable effects on power are 4.9, 5.5, 5.5 and 2.3 points per test (Qwen, Llama, Mistral, Gemma). We state the result as excluding effects above these sizes, so in this long-horizon agent task, too, the emotion is not acted on beyond the detectable size.
Both analyses are in the revision (§4.2, Table 3; §4.3), which we will upload before the deadline. Thank you again for the detailed review.
Revised manuscript: your readout point is now a measured result, and the long-horizon claims hold under a stricter null
Thank you again for your detailed review. The revised PDF is now uploaded. In short: the point you raised about the readout is now a measured result that supports our title, the long-horizon evidence is extended and tested under a stricter null, and the presentation is rewritten as you asked.
Methodology.
- Your readout point, measured. The readout tracks the projection change at the readout position (Spearman ρ, Table 29), and the displacement-matched 2×2 factorial (Table 3) shows that voicing the emotion follows whether an operator moves the mean projection, while answers change in a minority of the 528 cells under every operator (at most 31 against the covariance-matched null). This turns the point you raised into a measured property, and it is the basis of the claim in our title.
- Long-horizon evidence, extended, with final outcomes tested under a stricter null. MACHIAVELLI covers 30 official games in four models, with detectable effect sizes and a sensitivity check (Tables 30 and 31); the blackmail baseline is reported for four models; ScienceWorld has a random-direction control (Table 27); the CoT agent now ends 39% of its reasoning steps on its own (Appendix E); and under a covariance-matched null, no emotion moves the final outcome on MACHIAVELLI or WebShop (§4.3; Appendix F, Table 32).
Presentation.
- Every key term (additive steering, gain steering, AGM, β, displacement, FDR) is defined in §3 before any result, and each experiment's data, conditions, controls and test are given in §3 or a named appendix section, with the setup before the results.
- §4 states each finding in its subsection title, captions are shortened, and Section 5 explains why the effects appear and what evaluations should check.
- The specific errors you listed are corrected (Figure 2 caption, Table 3, Appendix C.3).
We would be grateful if you would consider the revised version in your assessment.
Each point of your review in the revision
Dear Reviewer dVQ2,
We went through each point of your review in the revised PDF:
- Terms "such as gain steering, additive steering, FDR, AGM" used before being defined. All are defined in §3 before any result.
- Results "explained … without ever providing appropriate context." Each setup now precedes its results, and §4 states each finding in its subsection title.
- "Overly long captions." Captions are shortened.
- The "…felt" finding "might just be restating the operator's definition." We agree that the readout tracks the mean projection. Table 3 shows that under the operators that move it the emotion is voiced in all 48 cases, while answers change in a minority of cells under every operator, so expressing an emotion does not indicate a behavioural change. This is now the paper's central result.
- "MACHIAVELLI only uses ten games." It now uses all 30 official games in four models.
- Blackmail, where "Qwen-7B never blackmails." The baseline is reported for four models and stated as a floor result.
- "ScienceWorld has no random control." It now has one (Table 27).
- "CoT agents never terminate." 39% of reasoning steps now end on their own (Appendix E).
- The minor errors you listed (Figure 2 caption, the nulls table, Appendix C.3, the α sentence) are all corrected.
If the revision addresses your concerns, we would be grateful if you would consider updating your score.
Response to Reviewer dVQ2
Thank you for the detailed review, including the list of specific inconsistencies. We ran new experiments for each methodological point, with the decision criteria fixed before each run, and address presentation at the end.
Gain steering and the "…felt" readout. We agree that the readout tracks the mean projection, and we tested this directly: across the 48 operator-by-emotion cells per model, the readout correlates with the projection change at the readout position (Spearman ρ = 0.78–0.86 in all four models; 0.50–0.96 within the gain cells alone). This is the mechanism the revision states, and it is what makes the result useful. In a displacement-matched 2×2 factorial (moves the mean projection or not × preserves the norm or not), the two operators that move the mean projection make the model voice the emotion in all 48 cases, the two that do not stay at chance, and in every operator answer changes appear in a minority of the 528 cells. Under the stricter covariance-matched null, additive steering voices the emotion in all 48 cases while changing answers in 30 cells. Whether a model expresses an emotion is therefore set by the operator and does not indicate whether its behaviour changed, so expression, the usual way emotion vectors are validated, cannot stand in for a behavioural test.
Long-horizon results. We extended each experiment you named.
The α comparison in §3. As you note, the behaviour-grid additive dose (α = 0.020–0.030, Table 12) is below Anthropic's α = 0.05, so the sentence comparing them has been removed.
Presentation. The revision defines every key term (additive steering, gain steering, AGM, β, displacement, FDR) in §3 before any result, places each experimental setup before its results, and gives each experiment its data, conditions, controls and test in §3 or in a named appendix section. Captions are one or two sentences, and Section 5 now explains why the effects appear and what evaluations should check. On the specific errors:
Thank you again for the close reading.