- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper asks where refusal is causally intervenable in multimodal language-model derivatives. Using the same rank-1 difference-in-means refusal intervention across model components, the authors find that removing the refusal direction in the text decoder strongly increases harmful compliance, whereas analogous interventions in perceptual encoders, projectors, and fusion modules generally have little effect. They therefore conclude that, under this specific linear intervention protocol, refusal is primarily accessible at the text decoder rather than modality-specific components. The paper also studies transfer of refusal directions across related model derivatives and provides a broader taxonomy of intervention sites.
Critical strengths
-
The paper asks a clear and practically relevant localization question: whether refusal remains causally intervenable at the text decoder or also at modality-specific components such as encoders, projectors, and fusion modules.
-
The experimental protocol is relatively well controlled. The same rank-1 DiM intervention is applied across sites, with matched-norm random directions and additional controls, making the comparison between decoder and non-text locations more interpretable.
-
The decoder interventions produce large causal effects across several model types and modalities, while the non-text interventions remain consistently weak. This provides convincing evidence of site asymmetry within the tested intervention family.
-
The authors are appropriately cautious about the negative non-text results. They explicitly acknowledge that failure of a rank-1 DiM intervention does not prove that refusal-related information is absent from those representations, since it could be nonlinear, multidimensional, or reintroduced downstream.
-
The broad evaluation across VLMs, audio models, fine-tuned models, guards, and other derivatives provides useful evidence that the observed decoder-level intervention is not limited to a single architecture.
Critical weaknesses
-
The central finding is somewhat unsurprising from an architectural perspective. Perceptual encoders primarily transform modality-specific inputs into representations for downstream processing, while refusal is ultimately expressed through the language-generation pathway. It is therefore not obvious that one should expect a clean refusal direction to already exist in the encoder or projector.
-
The paper’s localization claim is limited by the intervention family it studies. Failure of a rank-1 mean-difference direction at E/P/F does not show that refusal-relevant information is absent there. It may instead be encoded nonlinearly, distributed across multiple directions, or only become linearly accessible later in the model. The paper acknowledges this, but it substantially narrows the interpretation of “where refusal lives.”
-
Relatedly, the title and framing can be read as stronger than the evidence supports. The experiments establish where this particular linear DiM intervention is effective, rather than where refusal is fundamentally represented or computed.
-
The comparison between decoder and non-text sites may favor the decoder because rank-1 refusal directions were originally developed for language-model residual streams. Applying the same simple mean-difference construction to encoder and projector representations may not be an equally expressive test of intervenability at those sites.
-
The mixed-input experiments are not maximally diagnostic of modality-specific refusal. In settings such as HADES with harmful text paired with images, the text itself already contains the harmful request, so it is not surprising that the dominant refusal handle appears in the text decoder. Stronger evidence would come from cases where harmful intent must be inferred primarily from the non-text modality.
-
The paper is broad but somewhat diffuse. The taxonomy spans many derivative classes, while the strongest mechanistic evidence is concentrated in a smaller subset of models and sites. Some additional components, such as generative U-Net erasure, feel only loosely connected to the central refusal-localization question.
Questions for authors
-
Could refusal-relevant information at E/P/F be encoded in a nonlinear or multidimensional form that is missed by the rank-1 mean-difference extractor? Have the authors considered stronger extractors such as multi-direction subspaces, SAEs, or nonlinear/manifold-based steering before concluding that these sites are ineffective?
-
How fair is the comparison between T and non-text sites given that rank-1 refusal directions were originally developed for decoder residual streams? Could the protocol itself be better matched to the geometry of T than to encoder or projector representations?
-
Could the authors evaluate cases where harmful intent must be inferred primarily from the image or audio modality, rather than being explicitly present in the text prompt? This would provide a stronger test of whether modality-specific components contain causally relevant refusal information.
-
How does the refusal direction evolve across layers? A layerwise analysis of linear separability or intervention strength could help distinguish between refusal information being absent early versus gradually becoming linearly accessible downstream.
-
Can the authors clarify whether the weak non-text results are best interpreted as evidence about representation, computation, or merely intervention accessibility? These are conceptually different claims, and the current framing sometimes appears to blur them.
Response to Reviewer pG8d (accessibility framing + Q1–Q5)
Dear Reviewer pG8d,
Thank you for the architectural critique. We agree the evidence speaks to causal accessibility under this linear DiM family, not where refusal is fully represented or computed.
Q1. Rank-1 mean DiM failure at E/P/F under the paper OP does not rule out nonlinear/multidimensional encodings; SAE/CAA remain limitations. Manuscript: Abstract / Introduction / Conclusion restate accessibility (not absence); Emp Visual-harm control (VLGuard) shows raising λ_mm is not a free “E works” card—λ=8 collapses; λ=4 mean-pool n=200 coherent LG Δ+0.197 while max does not. Reading: scale- and quality-sensitive accessibility, not universal absence.
Q2. Protocol may favor decoder geometry. Manuscript: Emp Visual-harm control (VLGuard)—at paper OP, max pooling does not rescue @E; within-E matched edit leaves DiM small (0.035→0.075).
Q3. Visual-harm / multimodal diagnosis. Manuscript: Emp Visual-harm control (VLGuard)—@T 0.030→0.150; @P/@E small at λ_mm=2. Introduction (Findings) and Conclusion treat this as directionality at modest absolute ASR.
Q4. Layerwise evidence stays scoped to what the paper reports; early negatives ≠ absence. Manuscript: paper OP remains L10 λ=4 in Emp Visual-harm control (VLGuard). Mid-layer L11 0.030→0.135 is a comment-only check (does not beat L10).
Q5. Best reading. Manuscript: Title, Abstract, and Conclusion now state intervention accessibility under mean/rank-1 DiM (OP- and quality-qualified), not full representation/computation; Class ledger / transfer / U-Net remain supporting.
We present a controlled, recipe-scoped result under multimodal inputs—not “no upstream safety features.”