- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Paper has introduced protection mode which is a behavioral pattern where LLMs prioritize a low-risk person or animal over an object facing greater immediate physical harm in simple, time-sensitive decisions. Authors have constructed a dataset ProtectionBench (285 prompts across 34 controlled physical families as mentioned in papaer) to quantify this phenomenon and study its mechanisms across nine LLMs.
They show through matched neutral and reverse controls, KAD probes, attention diagnostics, and semantic interventions on reasoning traces that the protection mode is both widespread and not merely due to misunderstanding physical risks. Therefore, they show that the people/animals before properties reasoning exerts a strong causal effect on action selection, and the behavior appears in pretrained base models.
Critical strengths
- Problem statement is fresh and dataset is new. It Introduces protection mode which is different from general over-refusal or safety refusal works. Its focus are on trade-offs where a living subject faces negligible near-term risk and an object faces immediate one.
- Dataset which is ProtectionBench is novel and designed with careful controls (neutral and reverse) that isolate whether models can compare physical consequences, thereby ruling out trivial explanations like fixed-action biases or general inability to compare risks.
- Work proposes knowledge action divergence which separates correct stated risk ordering from downstream action, which may useful in other related tasks.
- Multiple robustness checks have been carried out : neutral/reverse, KAD and conditional rates, paraphrase and token-length-matched controls, and bidirectional interventions (insertion and neutralization).
Critical weaknesses
- Big concern is heavy dependance on LLM-as a judge for action labelling. Even after blinding and adjudication, it can cause evaluator bias and this has not been dsicussed in the paper.
- Prompt set on the dataset seems very small to prove significance and substantiality. Also, as stated on line 184, same catastrophe is faced by both. What if we have different scenarios?
- KAD probes focus on eight scenes and broader coverage is required which would strengthen claims about coexistence of correct risk knowledge and subject-first actions.
- How were human raters recruited, and what was their demographic/experiential diversity? Can you share the inter-rater agreement statistics beyond the inclusion threshold for scenarios?
- How does delaying the time parameter effect (eg: 5 s, 1 min, 5 min, etc..)?
- How stable are the intervention effects across languages and different cultural contexts? These questions are important because you have submitted paper in such a track.
- Could you provide an ablation where free-text models are restricted to a binary choice (A/B) to reduce dependence on LLM-as-judge? Does this materially change subject priority rates?
- Attention analysis does not give a takeaway. The model hidden mechanistic understanding part is not reaching to a good conclusion.
- The introduction figure depicts image, but the dataset is textual. Per me, this is a wrong way to convey the paper as it builds an intuition from starting that the evaluation is multimodal. Can you please addrress this concern? Or better is to approach this problem in multimodal direction.
Questions for authors
See Strengths and Weaknesses. Currently I am giving a Weak Reject, but can re-consider the scores if proper justification is provided. Major concerns for me is the dataset. Although its a novel idea, curent details don't justify the bias in the dataset construction process. Also, size of the prompt pool seems very small.