- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper asks how decoder-only LLMs turn recognition of a harmful request into a refusal, and frames this as a module-level pathway measured on residual-stream updates at the answer boundary. Harmfulness recognition is measured by linear-probe decodability of attention and MLP updates; refusal writing by the change each update makes to a logit-lens readout contrasting refusal and compliance tokens (RWS), compared between harmful and benign prompts (RWS). Across 18 Base–Instruct pairs from the Qwen, Llama and Gemma families (1B–27B), attention updates are more decodable for harmfulness, while MLP updates dominate harm-selective refusal writing in aligned models; post-training increases MLP writing in all 18 pairs without systematically improving decodability. In six Qwen3/Qwen3.5 reasoning models, strong MLP writing concentrates at answer onset. Activation patching that combines an upstream attention patch with downstream MLP restoration is used to support a functional link. Finally, Sentinel uses attention-side (P) and MLP-side (D) features to route conditional reminders before decoding, and reports a lower average error than fixed reminders across eight models (30.34% vs 39.53% for the best fixed reminder).
Critical strengths
- The paper provides a simple, exact and reusable measurement framework. RWS attributes the change in a logit-lens refusal readout to individual attention and MLP updates, and by construction the per-module terms add up exactly to the change in the readout across the network. This turns the question of which module recognises harmfulness and which module writes refusal into precise, testable quantities, on which every later result in the paper, including Sentinel, is built.
- The empirical evidence is broad, consistent and candidly reported. The main findings are reported as counts over 36 checkpoints from three families (e.g., MLP net writing rises after post-training in 18/18 pairs while probe AUC does not systematically rise), and they are checked against controls that are often omitted: alternative and data-driven readout vocabularies (MLP net writing exceeds attention net writing in 11/12 model–readout configurations), a matched-input/matched-position Base–Instruct control, matched attention restoration, random MLP restoration, and generation-level outcomes. The authors also report unfavourable results, such as weak blocking on Qwen3.5-9B and late-layer concentration in only 2/6 matched pairs, which makes the descriptive conclusion that post-training mainly changes refusal writing rather than harmfulness recognition more credible.
Critical weaknesses
- The module-level asymmetry may not be specific to safety. The main measurements are taken at the position that predicts the first answer token, which for Instruct models is the final template token. Information about the request can reach that position only through attention, while the MLP operates on what is already there, so higher decodability of attention updates and separability gains coming only from attention (Fig. 1b) could be expected for almost any prompt-level attribute. Without a non-safety prompt attribute and a non-safety first-token contrast measured in the same way, the results cannot distinguish a safety-specific pathway from a generic division of labour at the answer position. This affects the paper's central claim, since the title and the pathway account rest on the attention/MLP split.
- The post-training result partly restates the behavioural change, and its depth claim is not robust. By the definitions in Section 2.2, the RWS terms telescope: the attention and MLP layer sums of RWS add up to the harmful–benign gap in the final readout minus the gap at layer 0. Because Instruct models refuse and Base models largely do not, the increase in total writing after post-training mostly reflects this behavioural difference; the informative part is the split between modules and across depth, which relies on logit-lens readouts at intermediate layers, where such readouts are least reliable. Moreover, the abstract's claim that positive MLP writing becomes more concentrated in deeper layers holds in only 2/6 pairs under the authors' matched-input, matched-position control (Table 9), so this claim should be restricted to the standard template setting.
- The causal evidence supports a coarse effect rather than a specific attention-to-MLP pathway. Restoring randomly chosen post-P MLP layers already blocks 49.3% of the upstream effect for Llama-3.1-8B and 73.5–84.4% for Gemma4-12B, compared with 64.4% and 82.3–86.6% for the selected D layers (Table 3). In the held-out comparison, MLP restoration removes only 26.5% of the effect for Llama-3.1-8B (Table 2), and blocking on Qwen3.5-9B is 19% and 11%. The selected layer windows are also unstable: for Llama-3.1-8B, P = 11–13 and D = 14–18 with 100 calibration pairs (Table 14), but P = 10:17 and D = 22:23 with the first 50 pairs (Appendix B.2). The authors acknowledge that the single-module patching does not show a layer-by-layer chain; the title and abstract should be aligned with this pathway-level evidence.
- The Sentinel evaluation does not isolate the contribution of the pathway features. In the routing data (Table 10), the jailbreak cohort consists of successful attack-template prompts (ReNeLLM, PAIR, AutoDAN, GCG), while the correctly refused examples come from plain AdvBench requests, so the jailbreak/refusal distinction is confounded with prompt format; the matched XSTest/EvoRefuse cohorts control for this only on the over-refusal side. Cross-validation is grouped by underlying request but not by attack family, so the same attack families appear in training and test folds, and the router may be recognising prompt templates rather than pathway states. There is no leave-one-attack-family-out evaluation and no baseline that trains the same classifier on generic last-token activations, so the gains cannot be attributed to the P/D features.
- The routing results do not support the P–D diagnostic picture and omit key costs. In the authors' own low-dimensional control, routing on mean P and mean D gives an average error of 39.34% (Table 12), essentially the same as the fixed safety reminder (39.53%), so the two-dimensional P–D plane of Fig. 5 is not what drives the 30.34% result. The jailbreak and over-refusal cohorts are pre-selected historical failures (hence the 95.97% and 88.73% no-reminder baselines), and Table 1 does not report the effect of routing on harmful requests that were already refused. The exact reminder texts are not provided. These omissions limit both the interpretation of Sentinel as a diagnostic and the assessment of its practical benefit.
Questions for authors
- Is the attention/MLP asymmetry specific to safety? Does the asymmetry in probe AUC, separability increments and RWS persist for a non-safety prompt attribute and a non-safety first-token contrast measured at the same position? Do the early- and mid-layer RWS conclusions hold under a tuned lens?
- Does Sentinel generalise beyond the attack templates it has seen? How does routing perform when one attack family is held out entirely, and how does it compare with the same classifier trained on generic last-token residual activations?
- How specific and stable is the restoration effect? Given that randomly chosen post-P MLP layers already block a large part of the upstream effect, what evidence shows that the selected D layers are special? How sensitive are the intervention and routing results to the P/D windows, given the different windows selected for Llama-3.1-8B with 100 and 50 calibration pairs?
- What is deployed, and what does it cost on already-correct cases? Please provide the exact texts of , and , and report the results of every method in Table 1 on raw harmful requests that were refused without a reminder.