- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes System Attention Bias (SAB), a training-free inference-time intervention that adds +logβ to the attention logits from non-system queries to system-role keys. The authors calibrate β under an MMLU capability budget and evaluate safety, over-refusal, role-specific policy compliance, attention dilution, and implementation overhead across several instruction-tuned LLMs. The paper reports safety gains for Qwen-0.5B and SmolLM2-1.7B under held-out AdvBench calibration, while also documenting important limitations including over-refusal, weak HarmBench transfer, non-monotonicity, and a substantial TinyLlama implementation artefact.
Critical strengths
-
The mechanism is simple, well motivated, and computationally attractive. Equation (1) precisely defines a role-conditioned additive attention mask, and Equation (2) correctly makes explicit that the intervention multiplies the unnormalised attention score of each selected system key by β.
-
The paper includes useful practical analyses rather than treating the intervention as free by assertion. The per-token comparison in Table 16 isolates the bias cost from differences in generation loops and reports a modest 0.2%to 1.7% overhead. The authors also appropriately distinguish this from the misleading end-to-end “speedups” in Table 15, which are caused by response-length and generation-loop differences.
Critical weaknesses
-
No head-to-head against the closest work.The paper calls Spotlight "the closest mechanism" but never runs it (or PASTA). Table 5 is just a structural checklist with author-defined categories — it says nothing about real trade-offs.
-
The biased span is wrong for 3 of 5 models. Exact only for Qwen and SmolLM2. TinyLlama's effect is a BOS artefact, Phi-3.5 leaks a user tag, Llama-3.1 includes BOS and drops a delimiter. So Eq. (1) isn't actually role-conditioned there, and those results need recomputing.
-
The "arbitrary policy" claim is one cherry-picked point.One model, 200 prompts, greedy decoding, β picked from an 8-value sweep on the same benchmark with no held-out split. The curve is non-monotonic, and the gain reverses under sampling (0.461 vs 0.434).
Questions for authors
Same as weakness.