- Rating
- 4
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper investigates whether the personality-like behaviors exhibited by Large Language Models (LLMs) can be evaluated, controlled, and combined within the weight space. Grounded in the classic OCEAN "Big Five" personality framework, the authors first define the behavioral characteristics associated with each personality trait. They then employ DPO and SFT techniques in a two-stage training process to develop LoRA adapters capable of either enhancing or suppressing specific personality dimensions. Subsequently, the authors conduct systematic experiments to evaluate whether these LoRAs can achieve personality control—both individually and in combination—thereby enabling the steering of the model toward specific personality profiles (mixed personality control). They also verify the method's generalizability across different models and teacher configurations. Furthermore, the authors explore downstream applications through "Frustration" and "WildJailbreak" experiments, demonstrating that personality modulation influences safety-related behaviors and holds practical value. Finally, recognizing that OCEAN is a classification framework originally designed for humans, the authors use unsupervised factor analysis on model interaction trajectories to extract latent, "AI-native" behavioral factors. This leads to the formulation of the TIDE framework and a preliminary exploration of the controllability of these factors, revealing significant differences in control efficacy based on the specific factor and the direction of intervention.
Critical strengths
- The research addresses a problem of practical significance and demonstrates potential value for downstream applications: As LLM application scenarios expand, understanding and modulating the behavioral tendencies of the models themselves is of real-world importance. The intervention method proposed in this paper offers a means to steer model behavior toward desired personality traits. Furthermore, the study goes beyond merely verifying personality control; through downstream experiments such as "Frustration" and "WildJailbreak," it demonstrates that adjusting model personality influences safety-relevant downstream behaviors, thereby highlighting the practical value and potential of this research direction.
- The paper features a cohesive narrative and comprehensive experiments, establishing a clear and logical chain of argumentation: The authors begin with the classic OCEAN personality theory to define and evaluate model personality traits. They then develop and implement a personality intervention method and conclude by discussing various control strategies (including individual, scaled, and combined control effects) alongside a thorough validation of robustness and generalizability. The overall presentation is highly complete.
- The paper goes beyond predefined human personality frameworks to explore latent behavioral factors in LLMs: The authors recognize and actively investigate the possibility that the concept of "persona" derived from human studies may not be directly applicable to LLMs, designing experiments to probe this distinction. Although this exploration is in its early stages, it offers crucial insights for the research community, particularly for future studies focused on LLM personas.·
Critical weaknesses
-
The novelty of the core intervention method is somewhat limited, although the paper offers distinct empirical and exploratory contributions. By employing LoRA to intervene in LLM personas, the paper does not propose a completely new paradigm for personality control but largely follows the technical trajectory of existing research. The authors acknowledge these connections to prior work, which I appreciate; however, this transparency does not eliminate the relatively incremental nature of the core intervention method. I believe the paper's true value lies in: 1. a systematic and comprehensive experimental design that validates the effectiveness, adjustability, composability, and robustness of personality intervention, together with downstream behavioral validation; 2. methodological transparency and experimental rigor; and 3. proactive reflection on existing research paradigms and the exploration of latent behavioral factors in LLMs via TIDE. Therefore, the paper could better highlight these distinct empirical and exploratory contributions, while recognizing that the novelty of the central intervention technique itself remains somewhat limited.
-
The scope of comprehensive validation for core experiments remains limited; specifically, the cross-model generalizability of TIDE has not been fully verified. Although the authors candidly acknowledge in the limitations section that the comprehensive evaluation framework focused primarily on Llama-3.1-8B-Instruct, this constraint still poses potential risks regarding generalizability. While the authors trained personality LoRAs on six LLMs and verified the method's applicability through select metrics and combination experiments, the full evaluation suite and most in-depth analyses remain centered on Llama-3.1-8B-Instruct. This issue is particularly pronounced for TIDE: the process of identifying key factors was based on interaction trajectories generated by Llama-3.1-8B-Instruct. Despite conducting a partial cross-model consistency check using Qwen2.5-7B-Instruct, the authors have not independently replicated the full factor discovery and control workflow on other models. Consequently, the current results may still be influenced by model-specific behavioral patterns, offering relatively limited support for TIDE's generalizability.
-
Evaluations relying on an LLM Judge entail uncertainties regarding reliability. The paper employs LLM judges for automated evaluation across several experiments. While the authors performed independent human calibration for the primary personality-scoring Judge, the Judges used for certain downstream safety-related evaluations did not undergo the same level of validation. These automated judges may still introduce additional judgment noise or systematic bias; however, these experiments provide crucial evidence supporting the downstream practical value of personality interventions, and additional validation would help establish the reliability of these downstream findings.
Questions for authors
-
The authors could further clarify the paper's contribution positioning in the Introduction, Contributions, and Related Work sections. Although the paper already acknowledges its relationship to prior studies, it would be helpful to more explicitly distinguish the inherited technical approaches from the paper's distinct contributions, particularly the systematic experimental validation of LoRA scaling and composition, downstream behavioral effects, methodological transparency, and the exploratory TIDE findings.
-
The overall presentation could be further polished, especially for some information-dense figures (e.g., Figure 4、5). Improvements to color contrast, label readability, legend clarity, and panel layout would make the experimental results easier to interpret and improve the overall reading experience.
-
The authors could consider supplementing the downstream evaluations (e.g., Frustration and WildJailbreak) with additional human–LLM agreement evidence. While the main personality-scoring judges have been calibrated against human raters, comparable validation is limited for the downstream judges. Clarifying whether any existing human validation is available, or providing a small-scale human agreement analysis if feasible, would help strengthen confidence in these downstream findings.
2 comments
response to author
I appreciate the author’s clarifications and commitment to making revisions. I will maintain my current score, as I consider this a solid piece of work that deserves to be accepted by ICLR. I look forward to future research that moves beyond human-centric frameworks to explore the inherent "personality" of the models themselves.
Thank you very much for the thorough review. Here are responses to the various comments and suggestions: