- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes PsyDrive, a psychology-grounded framework for role-playing agents that integrates core anxieties, compensatory desires, personality organization, and defense mechanisms into a stress-driven response generation architecture. The authors evaluate the framework through SocialBench comparisons, ablation studies, and stress-probe analyses, reporting improved benchmark performance and differences in generated responses across psychological conditions.
Critical strengths
-
An important and interesting research direction. The paper addresses the limitations of static persona-based role-playing agents by exploring how internal motivations and stress-driven psychological dynamics can shape character responses. This is a worthwhile direction for developing more context-sensitive and consistent role-playing agents.
-
A concrete implementation with empirical performance improvements. The authors operationalize psychological constructs within a structured response-generation architecture and provide benchmark comparisons and ablation studies. PsyDrive shows notable improvements over its base model on SocialBench.
Critical weaknesses
-
Insufficient theoretical justification for integrating psychological constructs. The paper draws on multiple psychological theories to construct its framework, but the rationale for selecting and connecting these constructs remains insufficiently established. In particular, it is unclear how the proposed categories and mappings are derived from the underlying theories, or why stress-driven and anxiety-based mechanisms are prioritized over other motivational processes. The framework appears to rely heavily on predefined design choices without sufficient justification for their psychological validity.
-
Misalignment between the research claims and empirical evaluation. Although the paper aims to model psychologically grounded motivations and authentic character responses, the evaluation primarily relies on SocialBench metrics that do not directly assess these constructs. The stress-probe analyses largely demonstrate that the predefined mechanisms operate as designed, rather than establishing their psychological validity.
Questions for authors
- How were the psychological constructs and their relationships selected and justified? In particular, what motivates the focus on anxiety and stress over other motivational processes?
- What evidence supports the psychological validity of the proposed taxonomy and the mappings between core anxieties, compensatory desires, personality organization, and defense mechanisms?
- How does performance on SocialBench demonstrate improvements in psychological depth or motivational coherence, beyond conventional role-playing capabilities?
- How do the stress-probe analyses establish psychological validity rather than simply confirming that the predefined rules operate as intended?
- Why was an uncensored Draft model used for the mechanistic analyses but not for the main experiments? How might this difference affect the interpretation of the findings?
We thank the reviewer for the careful reading. The new analyses are in the supplementary material; we summarize the conclusions here.
Q1. Core anxieties, compensatory desires, personality organization, and defenses are grounded in psychodynamic, attachment, moral, existential, and interpersonal theory (Appendices A–D). We prioritize anxiety/stress because interpersonal pressure makes defense mechanisms observable and yields an executable state-to-tier mapping. The taxonomy is a principled, executable subset tailored to role-playing rather than an exhaustive motivational theory, and we will state this scope explicitly.
Q2. The new evidence supports operational and construct validity in generation. The internal mechanism is checkpoint-invariant, the defense–impulse interaction survives alignment, the paired intervention shows that varying only the defense layer causally changes delivery, and tier lowering produces a graded response. Taken together, these establish causal, graded surface effects rather than a check that the rules run as designed (Table 24).
Q3. SocialBench measures role-playing and social consistency rather than psychological depth directly. Component isolation localizes the gain: defense-directed rewrite has the highest marginal efficiency, and gains over RichProfile concentrate in cross-turn memory dimensions, where RichProfile fails long-context consistency despite scoring higher on style and positive preference. This pattern is consistent with state accumulation and defense modulation (Table 29).
Q4. The paired and dose-response analyses manipulate only the defense layer while holding draft, history, and state fixed. Defense direction moves arousal and pragmatic markers in the predicted direction, tier lowering yields a monotonic pragmatic-marker gradient, and the aligned null is explained by the measured copy-rate compression. This is causal evidence about the mechanism rather than a confirmation of the implementation (Table 25).
Q5. We used the uncensored draft originally because aligned drafts and rewrites were too similar, which compressed surface observability. The main benchmark uses Qwen2.5-7B-Instruct, and the new Instruct probe shows the mechanism is present under both checkpoints, with only surface observability reduced under alignment (Table 21).