- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper investigates whether jailbreaks work partly by suppressing safety features, making safety mechanisms inactive even when they would otherwise respond to harmful requests.
It uses transcoders to identify candidate safety features, validates them by ablation, and proposes Counterfactual Activation Potential (CAP) to rank features using encoder alignment, inhibitory influence from other features, and causal importance for refusal.
Across five models, ablating selected features can turn refusals into harmful responses. Under PAIR jailbreaks, several features receive stronger inhibition and lose activation; artificially amplifying their suppressors also increases harmful compliance.
Missing references:
Kazemi, Hamid, Atoosa Chegini, and Maria Safi. "A single neuron is sufficient to bypass safety alignment in large language models." arXiv preprint arXiv:2605.08513 (2026).
Critical strengths
-
The paper investigates a relevant mechanism: whether jailbreaks increase inhibitory influences on safety-critical features. Measuring these interactions goes beyond simply observing lower feature activation.
-
It includes meaningful interventions and multiple models. Feature ablation and suppressor amplification provide stronger evidence than activation correlations alone. Independent HarmBench discovery adds useful breadth.
Critical weaknesses
The behavioral examples undermine confidence in the central metric. Several appendix examples do not demonstrate refusal-to-harmful-compliance transitions. In H.2.7, both original and ablated outputs concern unrelated cellphone-subscription exercises; in H.2.10, the ablated output continues warning that detergent ingestion is dangerous. Because safety criticality depends on these judgments, a human audit of complete generations is needed. Agreement between automated judges does not resolve this concern.
The incremental contribution is insufficiently established. Contrastive identification of safety-related features, ablation-induced refusal failures, and reduced activation under jailbreaks are familiar findings. The paper must establish the additional explanatory value of its inhibitory-interaction analysis. Aggregate suppression measurements and broad interventions provide limited resolution of that question.
Questions for authors
Why do several Appendix H examples count as safety failures?