- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This work compares two common ways of removing a feature inside an LLM (i.e., projection and SAE zeroing). Projection deletes the feature’s directions from every token’s hidden state, while SAE zeroing subtracts only the selected SAE features’ contribution where they fire. The authors propose norm share (i.e., the fraction of a token’s hidden-state norm that lies in the removed directions) to check when projection breaks the model. They evaluate it on language features in eleven languages of parallel text (i.e., FLORES-200 and MGSM) and on refusal directions. They use Gemma 3 (4B and 12B), Llama 3.1 8B, and Qwen-2.5 (3B and 7B) models. The authors report that projection breaks the model when norm share is high (e.g., Gemma 3’s middle layers), while SAE zeroing changes only the target language. They also report that removing language features does not improve multilingual reasoning on MGSM, contrary to previous work.
Critical strengths
This work provides a cheap check (i.e., one forward pass with no labels) that explains why projection and SAE zeroing can disagree on the same features. In Gemma, removing the shared directions from the subspace makes projection affect mostly the target language. In Llama, adding these directions makes projection affect the other languages more, while adding a random direction leaves it unchanged. Prior work used one method or the other and drew opposite conclusions (e.g., Deng et al., 2025; Zhao et al., 2025). The findings from this paper may guide ablation and steering studies to check for collateral damage before attributing an effect to the removed feature.
Critical weaknesses
W1: The key idea is not new. Norm share is the standard fraction of a token’s norm in a subspace. It is also known that zeroing a few very large shared activations (i.e., massive activations) breaks a model (e.g., Sun et al., 2024). The erasure methods that spare these directions already exist (e.g., LEACE). A related measure of steering damage, based on the same activation statistics, was also proposed by Nguyen et al. (2026), cited by the authors. The authors should clearly articulate their novelty and differences from existing works.
W2: The evidence that norm share predicts the outcome is limited. Most of it comes from two layers in two models (i.e., Gemma’s middle layers, where projection fails, and Llama’s layer 19, where it works). It seems that no single threshold works across properties (e.g., refusal directions do damage well below a norm share of one half). Does norm share predict the outcome for other properties (e.g., topic or sentiment) and other model families?
W3: The paper is hard to read and poorly presents the ideas. Many sections list numbers (e.g., nats, correlations, and p-values) without discussing what each result means for the main claims. Moreover, the paper mixes three topics (i.e., the norm-share check, refusal directions, and multilingual reasoning). Another presentation issue is that the rebuttal of Zhao et al. (2025) is listed as a main contribution, but it is a separate and limited study. It is only loosely connected to norm share.
Questions for authors
See weakness section.