- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2(+1)
- Soundness
- 2(+1)
Read review
Paper summary
This paper explores how persona descriptions map to behavioral responses in economics games, especially the Prisoner's Dilemma game. It localizes the persona-related sparse autoencoder (SAE) features associated with cooperative decisions. Experiments show that overriding such features can intervene the model behavior, and the writability shows a sharp transition at layer 15 in the tested model. The paper also shows as a proof of concept that the discovered feature signature can guide persona synthesis.
Critical strengths
- This paper explores the machanisms on how persona descriptions translate into model behaviors, showing the potential of making the process more interpretable and controllable.
- The experiment design uses multiple output-label mappings to separate behavioral features from features tied to answer tokens.
- Experiments are also conducted on other games such as Dictator to demonstrate how the discovered features
Critical weaknesses
- The paper is extremely hard to read even though I have plenty of research experience in this area and some background knowledge on activation-patching. Many abbreviations and concepts are used without providing definitions or contexts. For example, in the abstract and introduction, keywords like "SAE", "L15", "train-selected AB/CD set" occur multiple times, but late until Related Work or even Method, their meaning are given. The figure, table, and algorithm captions are also not helping. They merely describe how results are obtained and how variables are defined. The experiments and analyses are very unclear. For example, how the predictors are fitted? What are the left-hand side feature and what are the right-hand side outcomes? How the is measured? The Conclusion is also full of terms like "register" which is never formally defined. Overall, the whole paper reads like an AI-written one without careful polish.
- The paper poses a great research question on exploring the machenism of persona prompting, but the scientific implications of the findings, such as the phase transition in SAE layers and writable features, still remain unclear and underdiscussed.
- Only one subject model (Llama-3-8B-Instruct) has been tested, making it difficult to conclude if the discovered SAE features are model-specific or can also be detected on other LLMs.
- Some concepts seem to be defined arbitrarily. For example, "A feature is considered cooperation-associated under mapping m if it shows one-sided support for cooperative behavior: it is activated in at least k=5 verified cooperative rows while remaining inactive across all verified defective rows". Why using as the deciding boundary? The rigor of the paper could benefit from sensitivity checks on the configurations or a better justification written in the paper.
- Line 235 suggests that 9 responses are generated for the cross-game analysis, and many other experiments use . Given the randomness within LLM output generation, are the samples big enough to reliably make statistical conclusions?
Questions for authors
Please refer to the Critical Weaknesses section. In general, I think the authors could consider substantially revising the writing to better deliver the ideas and results.
4 comments
Q4(Weakness4):
Response.
We thank the reviewer for highlighting the importance of parameter sensitivity analysis. To examine the effect of the feature selection threshold, we have added a systematic support-threshold ablation by varying () from 1 to 6, while keeping the opposite-side zero-support criterion, persona-level data split, and intervention procedure fixed. The additional results are presented in Appendix S7.2(Table 5 and Figure 6).
The results reveal a trade-off between feature selection strictness and intervention effectiveness. With smaller thresholds, more SAE features are selected, maintaining strong intervention effects in PD and binary cross-game evaluations. However, overly permissive selection may introduce less reliable features and unintended effects. For example, at (), although the answer-slot cooperation probability approaches 1.0, only 58 out of 100 greedy generations produce the exact target action C. Transfer to the amount-choice Dictator task is also limited, with mean giving increasing only from 8.1 to 8.5.
Conversely, excessively increasing the threshold reduces the selected feature pool and weakens intervention effectiveness. At (k=6), the PD cooperation probability under defection-to-cooperation intervention decreases to 0.754, and the exact greedy-C rate drops to 88/100.
We therefore select (k=5) as an empirical compromise. It retains effective PD and binary cross-game interventions, achieves 99/100 exact greedy-C outputs, and provides substantially stronger transfer to the amount-choice Dictator task, increasing mean giving from 8.1 to 19.0. These results provide an empirical justification for our choice of (), rather than treating it as an arbitrary threshold.
Second, we additionally conduct intervention-strength ablations by varying () to examine how the magnitude of feature interventions affects behavioral outcomes in Appendix S11 ( Figure 9). This analysis provides further insight into the sensitivity of our causal intervention results to the intervention strength, rather than relying on a single configuration.
Together, these additional ablations provide a more systematic assessment of the sensitivity of our feature selection and intervention procedures to their key parameters. The corresponding results and discussions have been incorporated into the revised manuscript.
Q5(Weakness5):
Response.
We thank the reviewer for raising this concern regarding the statistical reliability of our experimental findings. To address the limited sample sizes in the original cross-game transfer experiments, we have expanded the evaluation to include all 100 behaviorally verified personas, rather than relying on subsets of only 5–10 personas or a small number of generated responses. The expanded results are now reported in Table 1, providing a more comprehensive evaluation of the consistency and generalizability of our findings across personas.
I appreciate the authors' efforts in revising the manuscript and providing the additional results. I raised up my score accordingly.
Thank you very much for reconsidering our submission. We sincerely appreciate your recognition of our revision efforts and the additional experiments. Your constructive feedback has also been very helpful in improving the clarity and scientific rigor of our work.
Q1(Weakness1):
Response.
We sincerely thank the reviewer for this detailed feedback and helpful suggestions. To make the key concepts, experimental procedures, and findings more accessible and clearly presented, we have further revised the manuscript, with particular attention to terminology, methodological descriptions, and the presentation of experimental results.
Specifically, we have made the following revisions:
Terminology and definitions: We have introduced key abbreviations and concepts at their first occurrence and clarified terms such as SAE, L15, and the feature-selection procedure. We have also simplified technical shorthand in the Abstract and Introduction to make the main ideas more accessible.
Figures, tables, and algorithm descriptions: We have revised the corresponding captions to better explain the purpose of each experiment, the meaning of the variables, and the interpretation of the reported results, rather than focusing primarily on procedural details.
Methodological clarity: We have expanded the explanations of the prediction and readout procedures, explicitly clarifying the input features, prediction targets, model-fitting procedures, and evaluation metrics. This makes the relationship between SAE activations and behavioral outcomes more transparent.
Experimental analysis: We have reorganized and clarified several experimental descriptions to better explain the motivation, evaluation procedures, and interpretation of the findings.
Conclusion and overall presentation: We have clarified ambiguous terminology, including terms that were not sufficiently explained, and revised the Conclusion to better summarize the main findings and their scientific implications. Finally, we have reviewed the manuscript to improve terminology consistency, logical transitions, and academic writing throughout. We appreciate the reviewer’s suggestions, which helped us further improve the clarity and accessibility of the presentation.
Q2(Weakness2):
Response
We thank the reviewer for this insightful comment. Following the reviewer's suggestion, we have expanded the Discussion section to further interpret the layer-wise writability results, explain the significance of writable features, and highlight the broader implications of our findings for understanding persona prompting.
First, regarding the observed layer-wise transition, our results show that interventions at earlier layers (e.g., L13) do not effectively alter the final decision, whereas intervention effects emerge around L15 and become substantially stronger in subsequent layers. We interpret this finding as suggesting a distinction between the formation of persona-related representations and their causal accessibility to the decision process.
Second, the writable features provide evidence beyond behavioral prediction or correlation. Through targeted interventions along the corresponding SAE decoder directions, we demonstrate that manipulating these features can systematically influence subsequent decisions in the expected directions. This provides evidence that the identified SAE directions can also exert causal effects on model decisions under our intervention settings.
Finally, the revised Discussion brings together our main findings and their broader implications. Behaviorally verified persona contrasts enable the identification of behavior-associated SAE features; targeted interventions reveal their causal influence on decisions; and cross-game evaluations show that behavioral readout generalizes more broadly than intervention effects, which remain more task-dependent. Together, these findings suggest that persona-induced behavioral tendencies can be studied at the level of internal representations, while highlighting the distinction between representing behavioral tendencies, predicting decisions, and causally influencing them.
We have incorporated these interpretations into the revised Discussion to provide a clearer account of the scientific implications and scope of our findings.
Q3(Weakness3):
Response.
We thank the reviewer for raising this important question. To examine whether our findings are specific to Llama-3-8B-Instruct, we have extended the experimental pipeline to two additional model families, Gemma-2-9B-IT and Qwen3-8B
The additional cross-model results are presented in Appendix S15 (Figures 12–16). Across these models, we successfully identify SAE features associated with cooperative and defective behaviors and demonstrate their causal effects through interventions along the corresponding decoder directions.
These results provide evidence that our proposed workflow and the associated functional patterns can also be identified and causally investigated across different model architectures. We note that this generalization concerns the identification of functionally similar behavior-associated representations.