- Rating
- 3
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes the Persona Hierarchy Model, which posits that LLMs possess a shared default persona alongside context-specific local personas. During fine-tuning, the closer the trained persona is to the default persona, the more readily the learned behavior generalizes to other contexts. The authors experimentally validate a significant correlation between persona distance and the scope of behavioral generalization, and further demonstrate that training history and persona alignment can influence the degree of generalization. Building on this, the paper proposes PPR, which constrains the cross-context propagation of undesirable behaviors by protecting the default persona, thereby offering a new theoretical account and technical approach for safety alignment and controllable generalization of LLMs.
Critical strengths
- The phenomenon identified by the authors exhibits a certain of novelty.
- The authors discuss in detail how their findings can be applied to the post-training, which can inspire the future research.
Critical weaknesses
My main concern is that the current experiments do not substantiate the authors' claims. The paper defines personas solely via different system prompts, yet it neither verifies whether these prompts actually activate the intended personas nor rules out confounding factors such as the wording and semantics of the prompts themselves. It therefore remains unclear whether the differences in behavioral generalization stem from a persona mechanism or from the system prompts.
Questions for authors
Although the authors interpret their findings through the lens of persona theory, the underlying mechanism is essentially implemented by swapping system prompts and altering instruction. While the findings have clear practical value, I believe that streamlining the paper's claims and presentation would better help readers learn the core contribution and would be more likely to inspire the community.
2 comments
Thank you for your detailed rebuttal. I have decided to maintain my positive score. I do not increase my score because, based on my original review, I do not suppose that the paper warrants the highest score.
Thank you for your positive assessment and feedback. We would like to clarify the structure of our work. As stated in our introduction, the Persona Hierarchy Model is our proposed hypothesis to understand contextual generalization. Our work makes empirical claims to test this hypothesis.
We reveal that the distance between a prompt’s persona vector, measured from the model’s hidden states, and the default persona vector correlates with how narrowly learned behaviors generalize, supported by extensive experiments on varied datasets in Sec. 4. The correlation is further substantiated by intervention experiments showing that aligning with the default persona can broaden generalization (Sec. 5).
Our experiments test our empirical claims directly: the correlation is observed across four behaviors and three models (Sec. 4, Figure 3), and interventions that move a context toward the default can broaden generalization (Sec. 5).
Thank you for your review. We clarify that we do not predefine personas. We measure the persona that each system prompt elicits from the model’s internal representations as its persona vector, following prior work that represents personas by model activations (Chen et al., 2026; Lu et al., 2026).
Our finding rests on the measured persona vector elicited by a given prompt, not on what a prompt describes. It does not require verifying that a prompt activates an intended persona.
References
Thank you for your comment.
Empirical results suggest that surface properties of the system prompt itself may not account for the correlation:
Section 5 shows generalization can change under the same system prompt. We hold the prompt text fixed and align the model’s responses under that prompt with its responses under the default prefix. This reduces the measured persona distance and broadens the generalization of subsequently trained behaviors. Applying the same alignment procedure with other persona targets produces smaller effects (Table 2). These results provide intervention evidence that complements the correlation in Sec. 4, supporting our hypothesis.
We separately examine whether simpler prompt properties explain this relationship here.
Together, these results imply the relevance of the elicited representation beyond differences in prompt text alone.
We need to clarify our contributions do not claim that persona is the only cause for generalization or we exhaustively rule out all the other potential mechanisms, which is very hard. We leave what may shape a persona elicited as future work.
Instead, our work's core claim highlights the correlation between persona and how broadly a learned behavior generalizes across contexts with sufficient empirical support. We will further improve our presentation to make our contributions more clear.
Varying the system prompt is indeed the core of our setting: we study how a behavior learned under one system prompt generalizes to others, which matters in practice because models are routinely fine-tuned under one prompt and deployed under others.
Thank you for acknowledging the value of our work. Following your suggestion, we have further refined our writing to make things more explicit in our updated PDF (changes highlighted in blue) and will keep refining our presentation.