- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper compares models’ default choices, their choices when role-playing historical figures, and their answers about those figures’ actual historical actions to investigate whether models’ own behavioral tendencies persist during role-play. The authors further examine different training stages and interventions, framing the findings as evidence for a persistent self underlying different personas.
However, my main concern is that the paper omits discussion of many existing studies on personality alignment and role-playing. Its contributions appear similar to those of several prior works, making it unclear to me what its main contribution is beyond existing research.
Critical strengths
I appreciate the paper’s clear logical structure and the authors’ efforts to investigate the same question through multiple experiments.
Critical weaknesses
For me, the main concern is the insufficient coverage of related work and the unclear positioning of the contribution. I did not find discussion of or comparisons with Personality Alignment of Large Language Models, Character-LLM (EMNLP 2023), InCharacter (ACL 2024), Character is Destiny / LIFECHOICE (Findings of EMNLP 2025), or RoleCDE.
In my view, the paper’s findings and contributions closely resemble those of these works. In particular, prior research has directly examined conflicts between role-specific values and models’ alignment tendencies, observing that models often favor decisions consistent with their default alignment and moral norms even when explicitly assigned a role. This is closely related to the present paper’s finding that role prompts do not fully override models’ own behavioral tendencies.
Questions for authors
The authors should clarify what new research question the paper addresses, why existing role-playing evaluations are insufficient to answer it, and what the new experimental design can distinguish or rule out that previous approaches could not.
I recommend that the authors rewrite the introduction and carefully revise and reorganize the substantive content of the paper.