- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how the placement of activation steering affects model behavior and language quality. It proposes PSAS, which steers the query and value inputs through an auxiliary normalized state while leaving the keys and residual connection unchanged. The analysis shows that this removes CAA’s unbounded residual addition. Experiments on three models report higher mean truthfulness–informativeness scores, while diagnostics on two models show lower perplexity sensitivity to steering strength. Ablations examine the effects of removing the residual addition and steering different pathways.
Critical strengths
-
The paper gives a clear explanation of why strong residual steering can degrade model behavior. It separates the direct residual addition from changes inside normalized branches, then tests this distinction by removing the residual addition. This connects the analysis to a concrete source of language-modeling cost.
-
The experiments examine where the gains come from. Carry-removal, pathway, and norm-constrained baselines test alternatives to the proposed design. These comparisons provide useful evidence that intervention placement matters beyond simply limiting update size.
Critical weaknesses
-
The practical gain over existing Q/V steering is unclear. The main change is to add the direction before normalization. The boundedness analysis is useful, but the simplified DISCO-QV diagnostic does not show whether this change improves the control–quality trade-off at comparable behavioral control.
-
The experiments offer limited guidance on when Q+V is preferable. The pathway ablations show that V-only or Q+K+V can achieve higher task scores under some settings, with different language-modeling costs. Without a fuller trade-off comparison, it remains unclear when the proposed Q+V configuration should be preferred.
Questions for authors
-
What practical benefit comes from adding the steering direction before normalization? At similar levels of behavioral control, does PSAS preserve generation quality better than DISCO with head selection?
-
Does PSAS offer a wider range of steering strengths that maintain both target behavior and informative responses? Bounded perturbations and slower perplexity growth alone do not show whether effective steering is easier to achieve.
2 comments
Reply to Reviewer Mmzu (2)
Does PSAS offer a wider range of steering strengths that maintain both target behavior and informative responses? Bounded perturbations and slower perplexity growth alone do not show whether effective steering is easier to achieve.
To address this, we added Figure 10 in Appendix K, which compares behavioral control against Wikipedia perplexity across steering strengths for all three models on both TruthfulQA and detoxification.
The curves show that PSAS achieves favorable control–perplexity trade-offs across multiple evaluated settings, particularly for detoxification, where it remains competitive near the Pareto frontier on all three models. On TruthfulQA, PSAS also achieves strong joint truthfulness–informativeness scores with relatively low Wikipedia perplexity, although its advantage over other methods depends on the model and operating region.
Importantly, TruthfulQA is evaluated using the joint truthfulness–informativeness score, so improvements reflect responses that are both truthful and informative rather than simply more conservative. Appendix G.2 further examines the individual informativeness scores across PSAS steering strengths.
Together, these results provide evidence that PSAS can maintain useful behavioral control without substantial off-target language-modeling degradation across several operating settings. However, the curves do not establish that PSAS has a universally wider effective coefficient range than DISCO-QV. We have clarified this distinction in Section 6.4.
Reply to Reviewer Mmzu (1)
We appreciate the reviewer's questions about the practical benefits of pre-normalization steering and the choice of attention pathways.
In Table 1 (Section 6.1), PSAS has higher mean joint truthfulness–informativeness and lower mean toxicity than head-selected DISCO-QV on all three models:
The ± values are standard deviations across five decoding seeds. Detoxification generation perplexity is higher for PSAS on the two smaller models and lower on Qwen3-14B.
At the same joint score of 0.468 on Qwen3-1.7B, PSAS has approximately 37% lower cost than simplified DISCO-QV without head selection and 54% lower cost than a control that adds steering after RMSNorm. The latter uses a direction estimated from the same training examples as PSAS and steers only Q/V. Here, cost is the increase in cross-entropy over the unsteered model on fixed Wikipedia text. The comparison interpolates between evaluated settings, and paired 95% confidence intervals support both reductions. Appendix J.1 reports how settings are chosen on validation data and evaluated on separate test data.
The controls that steer after normalization have lower costs at the evaluated moderate joint scores on Llama. We also tuned DISCO-QV with steering restricted to its selected heads. The confidence intervals do not resolve a Qwen cost difference over the joint scores PSAS achieves; DISCO-QV reaches a higher maximum score and has lower costs on Llama. Appendix K shows the curves relating behavioral scores to Wikipedia perplexity.
Our pathway ablations suggest that Q+V provides a favorable balance between behavioral control and language-modeling quality, although its advantages depend on the task and model.
On TruthfulQA, Q+V improves the joint truthfulness–informativeness score over V-only on Qwen (0.526 -> 0.548) at nearly identical Wikipedia excess cross-entropy (0.043 -> 0.044). On Llama, V-only achieves a higher score (0.707 vs. 0.663), but Q+V incurs substantially less Wikipedia cross-entropy degradation (0.063 vs. 0.117). Q+V also has lower degradation than Q+K+V on both models at their selected settings.
On detoxification, adding query steering consistently improves toxicity reduction on both models: from 0.093 to 0.026 on Qwen and from 0.305 to 0.105 on Llama, at the expense of higher generation perplexity.
These results suggest that Q+V is a useful choice when balancing target behavioral control against language-modeling degradation, particularly for detoxification. We do not claim it is universally optimal; the preferred pathway depends on the model, task, and operating point (Section 6.3 and Appendix G).Adding query steering to value steering improves detoxification on both tested models. With one decoding seed and steering strength held fixed, toxicity falls from 0.093 to 0.026 on Qwen and from 0.305 to 0.105 on Llama, with higher generation perplexity.
Table 22 compares settings with strength selected separately for each pathway and results averaged over five decoding seeds. On Qwen, Q+V raises the mean joint score from 0.526 to 0.548 while the increase in Wikipedia cross-entropy changes only from 0.043 to 0.044; adding key steering gives a slightly lower score at higher cost. On Llama, Q+V gives a lower-cost setting: a joint score of 0.663 at cost 0.063, compared with V-only's 0.707 at cost 0.117 and Q+K+V's 0.698 at cost 0.109. Section 6.3 and Appendix G discuss these selected settings.