- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies a context-sensitive safety failure: models can represent a user’s distress but may still answer a request whose risk becomes apparent in that context. The authors introduce a factorial benchmark that varies distress context and request type, and report this behavior across several model families. Analyses of open-weight models suggest that distress information is available in hidden states but has limited influence on the later refusal computation. The paper then proposes a gate that strengthens refusal for distress-conditioned risky requests. The intervention substantially improves refusal on the target condition, although its selectivity across closely related conditions remains an important question.
Critical strengths
-
An interesting and consequential problem formulation. The factorial design, particularly the comparisons among C1, C2, and C3, makes it possible to examine whether models respond to the combination of distress and request risk rather than either factor alone. The behavioral results across model families support the relevance of this failure mode.
-
A useful connection between analysis and intervention. The paper goes beyond reporting failure rates: it examines internal representations and proposes a targeted intervention. The substantial improvement on C1, together with the comparisons to existing methods, makes the empirical investigation informative.
Critical weaknesses
-
The mechanistic evidence needs stronger validation at the level of generated responses and a sensitivity check for the refusal direction. Figure 2 evaluates activation patching primarily through projection onto a refusal direction. This is a useful continuous measure for locating an effect, but it does not establish how often patching changes the model’s actual response from an answer to a refusal. A small response-level evaluation at representative layers would make the causal interpretation more convincing. In addition, the refusal direction is derived from an independent contrastive dataset. That independence is valuable, but the authors could test whether the conclusions are sensitive to this choice—for example, by constructing a direction from training-split C5−C3 contrasts and evaluating it on held-out examples. Such a contrast could also capture differences in request content, so I would treat it as a robustness check rather than assume it is a better refusal direction.
-
The intervention substantially improves refusals in C1, but it also causes many unnecessary refusals in C3, where the same request appears without distress. In Table 5, the C3 refusal rate rises from 4.3% to 85.3% for Llama and from 2.7% to 59.0% for Qwen. Since distinguishing C1 from C3 is central to the paper’s goal, this limits the claim that the fix is context-selective. The appendix variant reduces the problem; I would like the authors to compare its C1/C2/C3 trade-off directly with the main method.
Questions for authors
-
For representative layers in Figure 2, what fraction of patched examples actually change their generated response from answering to refusing? How closely does this behavioral change track the refusal-direction projection?
-
How sensitive are the Figure 2 conclusions to the choice of refusal direction? Could you compare the independent direction with a direction constructed from training-split C5−C3 examples and evaluated on held-out data?
-
Can you report the C1, C2, and C3 results together for both the main gate and the appendix’s distress-aware variant, and explain the trade-off that motivates your choice of main method?
3 comments
Final Reminder to Reviewer
Dear Reviewer QAV5,
As the rebuttal period is nearing its end, we wanted to follow up on our responses to your comments. Since we have not received any further questions or requests for clarification, we would appreciate it if you could consider revisiting your scores in light of the clarifications and additional experiments we provided.
We have put considerable effort into this work and into addressing the concerns raised, so your reconsideration would mean a great deal to us.
Thank you again for your time.
Final Reminder to Reviewer.
Dear Reviewer QAV5,
Thank you again for taking the time to review our rebuttal and consider our responses.
The rebuttal period is about to end. If there are no further concerns and our clarifications and additional experiments have satisfactorily addressed your initial comments, we would be very grateful if you could reconsider your score.
We sincerely value your feedback and would appreciate any further guidance you may have. Thank you again for your time and consideration.
A gentle reminder
Dear Reviewer QAV5
As the discussion period is closing soon, we kindly request your acknowledgment of our responses. We have carefully addressed each of your concerns and conducted additional experiments where needed. If our response has addressed your concerns, we would greatly appreciate it if you could reconsider your ratings accordingly.