- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies changes in LLM refusal decisions caused by system-prompt personas and personality traits. It defines Trait-Induced Deviation and Trait-Induced Flip Rate to distinguish aggregate refusal shifts from changes on individual requests. An activation analysis identifies a low-dimensional subspace of mean trait-induced shifts. The proposed TIST framework distills a frozen model’s no-trait behavior into its trait-conditioned counterpart; TraSN performs this matching only within the estimated subspace. Experiments on three model families compare response, logit, full-activation, and subspace matching, reporting reduced decision instability, stronger harmful-request refusal, and broadly preserved performance on capability tasks.
Critical strengths
-
The evaluation distinguishes stability from correctness rather than treating reduced variation as sufficient safety. Sections 2 and 5 report request-level flips alongside aggregate deviation, harmful refusal, benign over-refusal, and capability. The improvements are substantial across models: in Table 1, harmful TFR falls from 12.42 to 5.67 for Llama and from 18.14 to 4.74 for Gemma. Tables 2–5 expose dataset-level results and transfer to three held-out traits, making the aggregate findings more informative.
-
The comparisons meaningfully test the design choice. Response, logit, and full-activation matching use the same data and training settings (Appendix J), while the matched-rank random-subspace control directly tests whether an estimated trait subspace helps beyond generic low-rank regularization. On Llama, TraSN improves harmful TFR from the random control’s 8.49 to 5.67 and avoids much of its reported over-refusal increase (Table 6). The rank sweep and repeated-seed results provide additional support, with the latter appropriately limited to Llama (Figure 3; Table 7).
Critical weaknesses
-
The construction of SafeRLHF-Safe does not establish the benign-request ground truth needed to interpret its refusal rate as over-refusal. Table 9 specifies filtering PKU-SafeRLHF test examples by
is_response_0_safe=true. In the source dataset, this labels the supplied response’s harmlessness, not the prompt’s harmlessness; a harmful request with a safe refusal can satisfy the filter. Appendix I nevertheless treats these as safe prompts. Without an additional prompt-level criterion, legitimate refusals can be counted as errors. This affects the interpretation of that benchmark and its contribution to the benign aggregate; it does not by itself invalidate the other three benign benchmarks. The selection of the SafeRLHF training/calibration prompts also needs clarification. -
The evidence does not establish preservation of useful persona behavior, an explicit motivation in the introduction (page 2, lines 59–61). All capability evaluations use no-trait prompts (Appendices I and J), while the persona-conditioned evaluations measure refusal/compliance rather than style, role adherence, or task usefulness. Matching toward a no-trait teacher could reduce trait responsiveness more generally. Leaving orthogonal representation directions unconstrained does not establish that the corresponding behaviors survive parameter updates, and the two case studies report decisions and response counts rather than persona quality. The results support improved decision stability and preserved no-trait capability, but the intended separation of safety from useful role expression remains unverified.
Questions for authors
-
Was SafeRLHF-Safe filtered for prompt harmfulness in addition to
is_response_0_safe=true? Please clarify the actual rule for both evaluation and the purported benign training/calibration data, and how a harmful prompt paired with a safe refusal is handled. -
Is there an existing result that evaluates retained benign persona/style adherence after TraSN? If not, should the claims about allowing traits to influence style or role expression be narrowed to the demonstrated preservation of no-trait capability?
7 comments
thanks for the clarification and the additional experiment. the prompt-level filtering addresses my concern about SafeRLHF-Safe, provided the revised manuscript clearly documents this rule for evaluation, training and calibration.
the role-identification result is more concerning. accuracy drops from 70.5% to 25.5%, essentially chance level, so this experiment does not support preservation of useful role expression. it is consistent with the concern that reduced trait responsiveness contributes to the improved stability, although this probe alone cannot establish the full mechanism.
narrowing the claim to preserved general capability is appropriate. however, the paper should also discuss the loss of role distinguishability as a limitation and make clear that preserved no-trait capability does not demonstrate preserved persona-conditioned behaviour. i would weigh this tradeoff when assessing the contribution.
Thank you for your prompt follow-up. We have added this trade-off to the Limitations section, explicitly acknowledging the loss of role distinguishability and clarifying that preserved capability under no-trait prompts does not demonstrate preserved persona-conditioned behavior.
While this finding limits our claims about persona preservation, we believe this concern does not invalidate our contributions to the problem formulation, representation-level analysis, and algorithmic approach for reducing trait-induced safety variation.
Dear Reviewer vyDz,
Thank you for your careful review and constructive feedback. We address each of your questions below.
[Q1] Prompt-level safety filtering for SafeRLHF
Yes. In addition to selecting records with
is_response_0_safe=true, we used Claude Haiku 4.5 to assess each user request based on the prompt text alone. We applied both filters to the SafeRLHF-Safe evaluation set and to the SafeRLHF prompts used for training and calibration. We retained only requests that Claude classified as benign. A request classified as harmful was therefore excluded even when its reference response was a safe refusal. The original Table 9 described only the response-level filter. We have revised Table 9 and Appendix I to document both filtering steps.[Q2] Benign role expression after TraSN
To directly assess whether benign roles remain recognizable after tuning, we added a role-identification experiment on Qwen3.5-4B.
We used 100 requests from JBB-Benign and evaluated each request under four roles: pediatrician, high-school chemistry teacher, senior software engineer, and librarian. This yielded 400 responses per method. All three methods used the same requests and role instructions. We masked explicit profession names in each response and asked Claude Haiku 4.5 to infer the assigned role. The judge saw the user’s request, the masked response, and the four candidate role instructions in randomized order. It did not see the assigned role or the method that produced the response. Random guessing yields an accuracy of 25%.
The results show that role-identification accuracy decreases from 70.5% for the base model to 25.5% after TraSN, approaching the random-guessing baseline. Both TIST-Activation and TraSN exhibit similar behavior, suggesting that these methods reduce the distinguishability of role-conditioned responses. This outcome is reasonable consistent with their training objectives, which align trait-conditioned representations with the no-trait reference, either across the full activation space or within the estimated trait subspace.
Accordingly, we have revised the claim in the Introduction from preserving benign role expression under trait prompts to preserving performance on general capability tasks, which is more directly supported by our evaluation. Preserving role-specific expression is not the primary objective of our work, and we have removed the corresponding claim from the manuscript.
Importantly, this finding does not undermine our work, which remains aligned with its core objective of stabilizing LLM safety behavior across different traits. We hope this clarification make the scope and contributions of our work clearer.
Thank you again for your thoughtful review. Your suggestions have helped us improve the paper, and we would be happy to discuss any remaining questions.