- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether persona-trait vectors can explain and predict jailbreak outcomes. It constructs a trait subspace and trains a logistic-regression detector, PersonaJB, on hidden-state projections onto these traits. Experiments on Llama-3.1-8B and Gemma-4-31B show improved average detection AUC on five unseen attack families. Steering and ablation experiments on Llama further show that modifying these directions can change refusal behavior.
Critical strengths
-
The detection gains appear on both evaluated models. PersonaJB achieves higher average OOD AUC than raw-activation and dimension-matched PCA probes. This supports the usefulness of the trait representation beyond reducing the number of features.
-
The paper tests interventions as well as predictions. Steering along PersonaJB and individual trait directions changes refusal behavior, while random-direction controls are substantially weaker. These experiments show that the identified directions can affect model behavior.
Critical weaknesses
-
The layer-selection procedure leaves the OOD comparison difficult to assess. Appendix A.3 states that OOD attacks do not enter model selection, but Appendix C motivates Llama layer 16 using its highest average transfer AUC. It is unclear whether this was a post-hoc observation or the criterion used to select the layer. Gemma’s layer-30 choice is also not explained through a comparable analysis. More generally, the paper needs a clear procedure for choosing an extraction layer and validating trait vectors on a new model without consulting the final test attacks.
-
The analysis does not establish whether trait scores predict outcomes beyond differences in request content. Different harmful-content categories may both produce different trait scores and have different jailbreak success rates. The paper compares attack families, but does not report category-controlled or within-request analyses. Behavior-disjoint splits do not rule out this explanation, and signal emergence at assistant-header tokens does not establish independence from content. This limits the interpretation of the results as evidence for a general persona-level account of jailbreaks. The exclusive use of traits, without evaluating role-based representations, further limits that scope.
Questions for authors
-
Was Llama layer 16 selected before examining OOD performance, or because it achieved the highest OOD AUC? How was Gemma layer 30 selected, and were baseline layers chosen using the same procedure?
-
Please provide, or identify in the released code, the 200 extraction questions, positive/negative system prompts, and scoring rubrics. How are response-token activations aggregated into the representation used to construct each trait vector?
-
Please specify the train/validation/test sizes, the WildJailbreak subset used for Gemma, and the tuning ranges and selected configurations for PersonaJB, the raw-activation probe, and the PCA probe. Were standardization and PCA fitted only on the training portion of each split?
-
Additional evidence needed for the current claim: For attack variants targeting the same original harmful request, do trait scores still distinguish successful from failed attacks? An analysis restricted to requests with both outcomes would help determine whether the detector captures attack-induced changes rather than mainly distinguishing easier requests from harder ones.