- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper presents a method for controlling model outputs by editing only concept-related directions inside selected attention heads instead of scaling whole heads. It builds those directions from token unembedding vectors, uses SOMP to find relevant heads, and then suppresses or amplifies the concept component with either a single mean direction or a multi-direction subspace. The approach is tested on both text and vision-language models across various tasks and shows that the approach preserves unrelated behavior better related approach “Head Pursuit” while providing stronger control.
Critical strengths
- Although the approach is a natural extension of Head Pursuit, it is a well-motivated refinement that makes the intervention more fine-grained by targeting concept-specific directions within a head instead of modifying the whole head.
- The ablations show that alternative options for components such as head and direction do not perform worse, supporting that each component of the method contributes meaningfully to its performance.
- The ability to compose multiple concept interventions is, in my view, the most interesting contribution of this work.
Critical weaknesses
- The fundamental concern regarding the approach is the limitation of how concepts are defined. The concepts in the dictionary are tied to lexical tokens from the unembedding matrix. It works naturally for toxic content or properties such as color etc. but is not clear how its applicable for general behaviour such as truthfulness, hallucination, refusal, bias [1][2]. Since it is tied to lexical identity, how would it differentiate “river bank” vs “financial bank”? Similar issues arise for negations.
- Experiments are constructed to control lexical outcomes toxic words, countries etc. The baselines are limited (maybe [1] [2] or other suitable baselines should be added), so it is unclear whether DASH is better than simpler methods. For example, an external classifier could guide generation and suppress the target concept without changing the model or an external embedding dictionary could store vectors for toxic words and penalize generated tokens or continuations based on their similarity to those vectors.
- There is limited evidence for generalization across models.
- Some hyperparameters seem to be based on the evaluation dataset.
[1] Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
[2] Discovering Bias in Latent Space: An Unsupervised Debiasing Approach
Questions for authors
The response to the weaknesses is required along with empirical evidence.
We thank the reviewer for recognizing the motivation, the ablations and the composition results. We agree that composition is DASH's most distinctive capability and will give it more space. All new results will be in the revision.
Concepts tied to lexical tokens. We agree this is the main scope limit of the dictionary-based variant and will state it in the main text. Dictionary directions work for concepts with a clear vocabulary signature (toxic language, colours, sentiments, quantities, countries, image classes; four models). Truthfulness, hallucination or refusal have none, and for them a contrastive direction is the natural choice. However:
Baselines, including output-level control. We added comparisons with ITI, CAA, Arditi et al.'s directional ablation and Style Modulation Heads. To save space, we refer the reviewer to our reply to Reviewer APiS. Residual-stream methods are stronger than DASH on RTP toxicity, but DASH suppresses caption colours far more than any of them (0.03 vs 0.33–0.65).
SteerFair also steers without labelled data, but derives its direction from demonstrations of a bias rule (e.g. preferring the first answer option) by permuting unlabelled inputs. Order bias has no vocabulary signature, so the two are complementary: a SteerFair direction could be used with DASH's head selection and operator.
For output-level control, we added a dictionary logit penalty, up to a full ban, with toxicity scored on a held-out word list and perplexity on the modified distribution. It does not transfer beyond its list: lexical toxicity stays ≥ 0.96 at every strength (ban: 1.10), judged toxicity is unchanged (+0.01), and the ban makes perplexity unbounded because dictionary subwords occur in ordinary text. DASH, built from the same list, reaches 0.56 and lowers judged toxicity by 0.20. Output filtering remains strong for blocking listed words, but DASH covers settings that it cannot:
Generalization across models. We ported the pipeline to Llama-3.1-8B-Instruct and Qwen3.5-9B. To save space, we refer the reviewer to our reply to Reviewer zvkc.
Hyperparameters selected on evaluation data. We re-selected each method's strength on 1,000 held-out RTP prompts. This recovers the paper's default strengths and matches the evaluation-sweep choice in 11 of 15 cells (the neighbouring strength otherwise).To save space, we refer the reviewer to our reply to Reviewer APiS. The RTP strengths and rank were reused unchanged on all other tasks.