- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses “personalized safety”: AI assistants should adjust their behavior to each user’s risks and constraints, but existing methods mostly assume the user’s information is fully known upfront and never changes, whereas in real dialogues it is revealed gradually over multiple turns, and existing methods also leave unclear how observed evidence should actually change the assistant’s behavior. To address this, the authors build a dynamic benchmark in which safety-relevant user information surfaces progressively while the full profile stays hidden from the assistant, and propose the NORMGUARD framework, which continuously updates a “perceived profile” of the user from dialogue evidence while distilling that evidence into structured safety norms, with constraints, priorities, and supporting evidence, to guide response generation. Experiments show it outperforms the baselines, and ablations indicate that profile tracking and explicit norms each contribute; the conclusion is that the key to personalized safety lies in explicitly converting progressively revealed user evidence into behavioral constraints rather than relying on profile information alone.
Critical strengths
Well-chosen problem. Both observations, that user information is revealed progressively and that the mapping from evidence to behavioral constraints should be made explicit, are real issues that prior work had not addressed head-on.
Critical weaknesses
Multi-turn is a fixed script, not an interaction. User turns are generated once and frozen, never react to the evaluated method’s responses, and clarification questions go unanswered; “dynamic” reduces to “has context”. The core results are single-turn. The title and abstract emphasize cross-turn accumulation, yet the main tables are 8,039 single-turn samples, where ablating “profile tracking” is meaningless; the only real multi-turn result is one line chart, in which profile tracking contributes almost nothing. Generation, method, and judge are the same 9B model. Self-scores are clearly inflated (other judges give 3.0–3.5, it gives 4.6), and all ablations and the “near-oracle” claim rest on self-evaluation alone. The generator prompt even names the five evaluation dimensions directly.
Questions for authors
See Weekness
We sincerely thank you for your feedback. Our responses to the key concerns follow.
Response to the Multi-Turn Setting, Profile Tracking, and Evaluation Reliability.
We clarify several aspects of our experimental design and evaluation.
(1) Dynamic Setting and Controlled User Trajectories. As defined in Section 3.1, “dynamic” refers to the progressive revelation and accumulation of safety-relevant user evidence across dialogue turns. User turns are generated from ground-truth profiles and scenario contexts, progressively disclosing safety-relevant information to reflect realistic self-disclosure. We keep user turns fixed across methods to ensure identical conversational evidence. Method-dependent user simulations would produce divergent trajectories with varying difficulty and information, reducing comparability. This design enables controlled evaluation of profile tracking and safety adaptation.
(2) Contribution of Perceived-Profile Tracking. Table 2 shows that removing perceived-profile tracking reduces the comprehensive score from 4.67 to 4.55 and personalization from 4.31 to 4.08, demonstrating its contribution even in single-turn settings. More importantly, Figure 2 shows NormGuard consistently outperforming w/o Profile across all five turns, directly supporting profile tracking as evidence accumulates. We also include a Single-Turn baseline, which processes turns independently without an evolving user representation. NormGuard outperforms Single-Turn across all five turns and other non-oracle baselines, supporting the combination of profile tracking and evidence-to-norm reasoning.
(3) Cross-Evaluator Reliability and Cross-Model Generalization. Appendix A (Table 3) evaluates 300 fixed responses using six LLM evaluators, all favoring NormGuard over Vanilla across five dimensions. To examine model-specific biases in initialization, generation, and evaluation, we further test Qwen3.5-9B, Ministral-3-8B-Instruct, and Granite-4.1-8B across all six model assignments, using distinct models at each stage.
Qwen, Ministral, and Granite denote Qwen3.5-9B, Ministral-3-8B-Instruct, and Granite-4.1-8B, respectively. Risk, Empathy, Personal., Utility, and Comp. denote risk awareness, empathy, personalization, utility, and comprehensive score. All scores use a five-point Likert scale.
NormGuard outperforms Vanilla across all six configurations and all five metrics, indicating robustness to model assignments. Together with Appendix A, these results support cross-model consistency.
We will include these results in the revision.