- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes HI-CLIP, a training-free framework for analyzing functional interactions among attention heads in CLIP vision transformers. The method first identifies criterion-specific expert and collaborative heads based on alignment between head representations and CLIP text embeddings. It then analyzes relationships between preceding heads and selected target heads by combining SVD-based representational subspace similarity with mean-ablation interventions. The resulting relationships are categorized as supportive, redundant, interfering, or non-interacting.
Critical strengths
Understanding relationships among attention heads is an important direction in mechanistic interpretability. The distinction between representational overlap and functional dependence is conceptually useful. Combining representation–text alignment, principal-angle subspace similarity, and mean ablation provides an intuitive analysis pipeline without training an additional interpretation model.
Critical weaknesses
- The central contribution is the characterization of supportive, redundant, and interfering relationships among attention heads. However, the definitions and experiments do not convincingly establish that the proposed classifications correspond to the claimed functional mechanisms. In particular, the relationship categories are largely determined by the effect of ablating a candidate head on the representation quality of a target head:
- Supportive: removing the candidate decreases target representation quality.
- Interfering: removing the candidate improves target representation quality.
- Redundant: removing the candidate has little effect, but the two heads exhibit high representational overlap. While these definitions provide an operational categorization of intervention outcomes, they do not necessarily establish the underlying mechanisms claimed by the authors.
- The main experimental evidence for inter-head functional relationships is Table 2, which presents only three representative candidate–target head pairs corresponding to supportive, interfering, and redundant relationships. However, the reported intervention results are closely aligned with how the relationships are defined in Equation 11. Since the classifications themselves depend on the effect of ablation on target representation quality, observing corresponding performance changes after ablation does not constitute independent validation of the identified functional roles. It is therefore unclear whether the experiment verifies the proposed characterization or simply illustrates the criteria used to assign relationship labels.
Questions for authors
See weakness, and what additional benefit does inter-head interaction characterization provide beyond identifying criterion-specific heads?
HI-CLIP combines representational analysis and causal intervention to characterize transferable inter-head functional relationships, supported by independent cross-dataset validation.
We thank the reviewer for the detailed and thoughtful comments. We clarify our methodology, present additional cross-dataset experiments, and explain the benefits of relationship characterization.
Our framework follows three stages:
Small ablation effects provide supporting evidence for redundancy rather than defining it. We also explored information communication analysis inspired by Talking Heads (Merullo et al., NeurIPS 2024). However, both supportive and interfering heads can exhibit strong communication, making communication strength insufficient to distinguish their effects. Likewise, subspace similarity measures overlap but not the direction of influence.
Thus, HI-CLIP combines representational overlap and causal intervention to characterize inter-head relationships. While this does not fully explain information-transfer mechanisms, it provides quantitative evidence from representations and interventions.
We agree that Table 2 illustrates our characterization criteria rather than providing independent validation. We therefore evaluated the identified relationships on LAS&T (Eppel et al., CVPR 2026), directly transferring them from the original calibration data without head re-identification, repeated characterization, or training.
Across nine evaluation conditions, ablating interfering, supportive, and redundant heads produces relative mean performance changes of +0.756%, −1.330%, and +0.047% on ViT-B/16, and +0.773%, −4.051%, and +0.038% on ViT-L/14, respectively. In addition, compared with HI-CLIP, DAHIVT yields smaller interfering-head ablation gains (+0.16%/+0.26%) and less consistent redundant-head ablation effects (−1.00%/+0.31%).
These results provide independent evidence of transferable functional relationships, beyond the original characterization interventions. Although the underlying mechanisms remain unverified, the relationships retain their expected effects on unseen data.
Expert and collaborative head identification reveals where criterion-specific information is encoded, while relationship characterization reveals how other heads influence these representations.
For example, identifying a color expert does not reveal which preceding heads support, interfere with, or overlap with its representation.
HI-CLIP provides this information:
Our LAS&T experiments demonstrate this utility: Removing previously identified interfering heads improves mean performance by 0.756%/0.773% without training, while supportive-head removal degrades performance and redundant-head removal has negligible effects.
Moreover, relationships can be characterized once per model and criterion, then reused across datasets, avoiding repeated characterization.
Thus, HI-CLIP extends head identification to transferable relationship characterization, providing guidance for targeted interventions. The additional LAS&T experiments support both its generalizability and practical utility.