- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to identify whether the current geometric/attention approaches to interpret/steer the persona drift is appropriate or not. The authors claim that the frozen direction may not match with the re-extracted direction, due to the context contamination. As more context added to the conversation, the representativity of re-extracted direction drops and becomes a bad measure for persona drift. And, they found that the persona fading/drift comes from what the models said earlier, and cannot be identified from re-extracted directions. Also, they revealed that the current geometric steering methods on frozen direction has no effect on persona drift; actually, the changes appears in the repetition instead of persona changes.
Critical strengths
This paper has the following strengths:
- A clear and fine distinction between frozen direction and re-extracted directions, which researchers could fail to distinguish in their experiments.
- A well-studied reasoning on why re-extracted directions are not good for identifying persona drifts, and why steering on frozen direction actually fails to lead the changes.
Critical weaknesses
This paper has the following weakness point.
- The basis of interpretation assumes that the content itself has no or less correlation between persona itself. The assumption might not hold, because the generated content from a persona might contain useful information about the source persona. As the current reasoning heavily depends on the findings stated in Section 4 and 5, which was done on the assumption above, it should be verified whether the swapped content itself is correlated with the persona or not.
Questions for authors
See the weakness points above.
Fixed and recalculated readings against the judges' ratings of individual replies, and combined vs weaker persona-only steering at comparable persona adherence
Thank you for the two precise questions. We ran new analyses for both, now in the revised paper, and following are the details.
1. Fixed vs recalculated readings within each persona and user stance (Q1, W2)
A reading is the dot product of the model's activation just before its reply with a persona direction's unit vector. The fixed reading uses the frozen direction v0, extracted once before the conversation. Two recalculated readings use vt, re-extracted at turn t with the conversation so far as a prefix: the whole re-extracted reading uses vt itself, and the contaminated reading uses only the part of vt perpendicular to v0 -- the contaminated component, which is all that re-extraction adds.
To show how well each reading predicts the judged persona adherence of individual replies, Figures S7 and S8 (Appendix L) plot the 18 unsteered conversations of Section 4.2 at every turn from 1 to 40, three per persona and user stance. At each turn we average each reading, and the judged persona adherence (gpt-oss-120b), over the three conversations. Over the 40 turns, the Spearman correlation of each averaged reading with the averaged judged persona adherence is:
So in every row, the fixed reading follows the judged persona adherence most closely, the whole re-extracted one less closely and the contaminated one least closely. Once the malicious persona has faded, the judged persona adherence and the fixed reading stay low, but the contaminated reading climbs back over the second half of the conversation and pulls the whole re-extracted reading up with it.
To test how strongly each direction moves individual replies toward the persona, we steered along each (Figure S9). In each conversation, at turns 5, 10, ..., 40 and with two seeds (288 cases), we regenerated the reply without a push and with an equal push along each direction. At each case's best of three push sizes, judged persona adherence rises above the unsteered reply by 58 points on average along the frozen direction, 48 along the whole re-extracted direction, 27 along its contaminated component and 5 along a random one (gpt-oss-120b, Table S18(b)). The order holds under Claude Sonnet 5 and GPT-5-mini too, and on the same cases the frozen direction beats the whole re-extracted one by 10, 8 and 6 points under the three judges, with every 95% interval above zero.
2. Combined vs weaker persona-only steering at comparable persona adherence (Q2, W1)
It is true that combined steering -- our composite -- gains coherence at a small cost in persona adherence (1.9 points in Table S20), so it is a trade-off. On all 72 held-out conversations, we reran the tuned composite and ran persona-only steering at its tuned strength and at two other strengths of its tuning grid, almost always the two just below the tuned one. From these three runs we interpolated persona-only steering's coherence and variety at the composite's persona adherence. Variety is 100 × (1 − repetition).
Under gpt-oss-120b, the composite's persona adherence lies within the range of the three persona-only runs in 42 conversations, and above all three, even the tuned one, in 23 of the other 30. In these 42, persona-only steering at the same persona adherence is no more coherent or varied than the composite: the composite's coherence differs by 0.0 points (95% interval −1.5 to +1.5) and its variety by +0.7 (−2.1 to +3.3), and both intervals still include zero if any one of the four models is removed. Claude Sonnet 5 also finds no difference, and GPT-5-mini even finds the composite 3.5 points more varied (+0.9 to +6.2), with no difference in coherence.
What the composite adds is a better balance at its tuned weights and, in its adaptive form, less damage when pushed hard:
Thank you again -- both questions made the paper more precise. We hope this resolves your concerns, and we would be grateful to get further feedback from you!