- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper investigates whether persona directions in LLMs can be represented as combinations of a small number of interpretable trait directions. The authors construct 60 traits, 37 personas, and 108 scenarios, extract activation directions from three models, and identify “persona recipes” containing a median of approximately six traits. They then add, subtract, or swap these recipes to evaluate persona recognition, sycophancy, and refusal behavior.
Overall, I think the paper is well presented. The figures are visually appealing, and I expect that a poster based on this work would attract considerable attention at the conference.
However, my main concern is that the contribution is unclear. To my knowledge, prior work has already investigated a wide range of personas using similar approaches, including Personality Alignment of Large Language Models. It was not immediately apparent to me how this work goes beyond existing research.
Critical strengths
I appreciate the quality of the figures, the logical organization of the paper, and the detailed experiments across multiple models.
Critical weaknesses
My main concern is that the contribution appears incremental. CAA has already studied behavioral control through the addition and subtraction of activation directions; Persona Vectors has extracted and controlled trait directions; and The Assistant Axis has investigated the overall structure of persona space. I have also encountered compositional approaches in Personality Alignment of Large Language Models.
The authors need to explain more clearly what their method adds to this body of work. I understand that traits offer one way to represent personas, but alternative representations are also possible. The paper does not clearly establish what specific advantages the trait-based representation provides or how well those advantages are supported by the results. As a reader, this makes it difficult to assess the contribution.
Questions for authors
The trait dictionary contains correlations and linear dependencies. Using different synonyms, scenarios, or bases could therefore produce different recipes. Have you tested how sensitive the recipes and their behavioral effects are to changes in prompt wording?
3 comments
Thank you to the authors for their response. I have carefully read the full response, sentence by sentence, but my concerns remain.
I am still unsure in which scenarios I would choose this method over existing, well-established alternatives. The improvements are marginal, and the contribution of the work itself is difficult to distinguish from that of prior work.
Response to reviewer XhpY
We thank the reviewer for reading our response closely and for the follow up. The two points that were raised which are when one would use this approach and how it differs from prior work.
When one would use it. Our paper studies what a persona direction is made of, and the steering experiments serve as the causal test of that description. For steering strength alone the full persona direction remains the better choice, as the paper reports. The trait decomposition then answers questions that a single direction leaves open, and we see four such scenarios.
- Auditing a behaviour direction : A direction found for sycophancy or refusal can be read as a mixture of named traits. In the paper the sycophant recipes of all three models share Gullible, less Creative and less Analytical, and subtracting a mixture of traits fitted to the refusal direction raises answers without refusal from about 2.6% to 66.7%.
- Comparing models : Recipes fitted independently on each model are expressed in the same vocabulary, and 34 of the 37 personas share at least one selected trait across the three models.
- Knowing what trait steering can reach : The recipe covers 0.62 of a role direction and 0.39 of a named persona direction, and in our new analysis this coverage predicts how recognisable a persona becomes when its recipe is added.
- Acting on one named component : In the new experiments each trait direction moves its own rating by 4.0 points more than the ratings of other traits on a scale from 1 to 7, and subsets of a recipe combine approximately additively, with additive models explaining 0.69 of the variance.
**How it differs from prior work : ** We have listed the exact differences from the closest works in our reply under the Area Chair's comment. We would be grateful if the reviewer could name the specific papers in which these results already appear, so that we can compare against them directly.
Response to reviewer XhpY
Thank you for your comments on the presentation and for asking us to clarify the contribution and its sensitivity.
Contribution and relation to prior work.
A trait decomposition makes several questions accessible. Which traits do two personas share? Which associations recur across models? How much of a persona direction can a trait description explain? Does changing a selected component change the resulting behaviour? Our paper brings these questions together in a common framework.
The relationship to the papers you identify is as follows. Thee CAA paper extracts the behavioural directions and use them for steering. The persona vectors paper monitors and controls the traits, and its SAE analysis examines those features associated with the respective trait directions. The Assistant Axis paper studies the geometry of the roles and traits and identifies directions that stabilise the Assistant persona. The Personality Alignment paper learns interventions that match individual preferences. Our paper studies wheteher these individual roles and named personas can be described through combinations of shared traits, and how those combinations then contribute to their behaviour.
Persona Vectors explicitly asks whether there exists a natural “persona basis”. We address this question by testing named traits as candidate components of persona representations. We extract the persona and trait directions separately, select combinations against a random dictionary reference, and measure both the part they explain and the remainder. Steering then tests whether the proposed description has behavioural consequences. This connects a readable account of a persona to measurable structure and intervention effects.
What the trait representation adds.
The representation provides four concrete forms of information.
A common description of different personas. Each persona is represented by a small set of signed traits, with a median of six. This makes shared components and model differences directly comparable. Across the three models, 34 of 37 personas share at least one selected trait.
A measure of how much trait language explains. The selected trait span captures, on average, 0.62 of a persona direction's length. These measurements establish where the trait description is informative and where substantial structure remains unexplained.
Tests of the proposed components. Steering each trait up versus down changes its own blind rating more than the ratings of other traits, by an average of 4.0 points on a scale from 1 to 7. All 60 traits move in the intended direction. Across all 64 subsets of six selected traits for eight personas, an additive model explains a mean of 0.69 of the variance in recognition.
A connection between representation and behaviour. In an analysis across the 37 personas, greater recipe coverage is associated with greater recognition when the recipe is added (Spearman correlation 0.39, 95% CI 0.06 to 0.66, p=0.016).
Stering with the whole persona direction remains stronger, as reported in the appendix. The decomposition adds access to the components, their shared structure and the limits of the trait explanation.
Anothe dictionary control using random words further tests this interpretation. In the evaluation, recognition falls to 8%, close to their random control at 7%. This supports the behavioural relevance of overlap with the trait span for these recipes.
Sensitivity to scenarios, wording and dictionary choice
We reran recipe selection under each change on Gemma 4 12B. For scenarios and wording, overlap is the number of shared signed traits divided by the number in either recipe. Dictionary overlap measures recovery of the original signed traits. For subsampling, the denominator includes only original traits still available in the smaller dictionary. The corresponding chance levels range from 0.06 to 0.11.
The recipes are most stable across situation splits. The synonym experiment also tests whether changing the vocabulary changes the behavioural effect. Its recognition rates are similar to those of the original dictionary under the same fixed dose protocol and judge panel.
We hope these responses address your questions and clarify our contribution. If our replies leave anything unclear or raise further concerns, we would welcome your feedback and suggestions for additional experiments that would help address them. We are also working to obtain human annotations for a random subset of the model responses and hope to share the results before the rebuttal period ends