- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper combines persona-based supervision, a shared activation controller, and post-training calibration to enable users to request different levels of trait expression based on a target mean score.
Critical strengths
Overall, I appreciate the distinction between what behaviors a model can express and how those behaviors can be requested on a behavioral score scale. This is a promising direction for interpretable research on LLM personality. Across three models and three core traits, the authors demonstrate stronger trait expression than CAA.
Critical weaknesses
-
The introduction is not well written, which also makes the method difficult to understand. The third paragraph introduces PersonaDose directly, before sufficiently explaining the motivation and background. As a reader, I do not understand why this approach is needed, how its different stages and modules were motivated, or what each contributes. These aspects need a more detailed explanation.
-
The evaluation lacks prompting and supervised fine-tuning (SFT), two standard intervention approaches. To my knowledge, AxBench found prompting to be a strong steering baseline. The proposed method itself uses cross-entropy training before calibration, so it remains unclear how much of its advantage comes from additional data and training. PersonaDose is trained on filtered persona responses, whereas the main direction-based baselines do not receive comparable response supervision.
-
There are only ten test questions per trait. This provides limited diversity, and I am concerned that the evaluation does not offer sufficient coverage to assess the method reliably.
-
The evaluation measures average scores across questions and responses, without guaranteeing that individual responses are close to the target. This definition allows substantially different output distributions to achieve equally good results.
Questions for authors
The paper’s main objective only requires the overall mean score to approach the requested value. This objective is clearly defined, but a low mean targeting error does not necessarily imply that responses exhibit a stable intermediate intensity. Mixing low- and high-intensity settings could also produce the same mean score.
I therefore hope the authors can explain what additional value continuous control provides over these simpler alternatives, such as more consistent performance across questions, fewer extreme responses, or lower control costs.