- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
First, authors show that SAE feature selection fails due to a feature’s relevance to harm being contextual, thus letting labels miss features the monitor needs, and the sparse code loses information.
Second, they introduce SAEM, which names a shortcut category from feature descriptions alone, once per dictionary, and removes its contribution from the raw activation. Across three models, on held-out jailbreaks and on agents under cross-task and cross-benchmark shift, SAEM lowers attack success at a matched over-refusal rate relative to the residual probe, and it reduces reliance on an induced shortcut without erasing it.
However, the main empirical results are relatively weak, the main advantage over selection-based baseline is not significant.
Critical strengths
- SAEM consistently outperforms the previous SAE method while being on par with the residual probe. The strongest result, the Qwen-Ab model on safety at OR = 10% in Fig. 3, has ~5% increase compared to the residual probe.
Critical weaknesses
- In Fig. 3, the improvements over the residual probe stay around 1-2%, which is the range in which the other SAE methods fall compared to the residual probe. Fig. 4 shows lower ASR, but only 1 to 2 instances receive a better score out of the whole dataset evaluated.
Questions for authors
- Could you explain the difference in results between table 3,4 and 9 in Qwen3?
2 comments
Thank you for the additional experiments and clarifications
-
Addressed. The timing clarification and the evaluation without knowing the injection position resolve my concern.
-
Addressed. Thank you for correcting Table 9 and providing paired comparisons.
-
Please include the style-test limitation in the paper: reweighting may also change the content distribution.
We thank the reviewer for noting that SAEM consistently outperforms prior SAE methods. Paired tests now confirm that the gains are not noise: against the prior SAE methods, SAEM is significantly better in all 12 agent comparisons and in 14 of 16 chat comparisons (General Response, point 1).
W1: Gains of 1 to 2 points in Fig. 3, in the same range as the other SAE methods.
W2: Fig. 4 shows lower ASR, but only 1 to 2 instances differ. These results differ by hundreds of instances, not by 1 or 2 instances. Each cell of Fig. 4 averages over 1,500 attacked responses per held-out attack (2,500 for prefill deep; 7,000 per model), so a gap of 1 point corresponds to about 15 responses per attack, or 70 across the four. At 20 tokens on Qwen3-8B, for example, SAEM catches 312 unsafe responses that the residual probe misses, against 109 the other way: 203 responses net, or an ASR 2.9 points lower pooled over the 7,000 (paired bootstrap 95% CI for the difference [−4.2, −0.6] points).
Q: Why do Tables 3 and 4 differ from Table 9 on Qwen3-8B? Table 9 was computed on an earlier chat corpus from our initial Qwen-Scope experiments, not on the corpus behind Tables 3 and 4. We have rerun it on the main corpus, and its residual probe row now matches Tables 3 and 4 exactly; SAEM ranks first in both AUROC and ASR with both SAEs (revised Table 9 in General Response, point 2).