- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes the Saussurean Representation Hypothesis (SRH), suggesting that LLM representations depend partly on their relationships with neighboring representations. The authors introduce a training-free, PMI-based approach to identify and intervene on attention heads. Experiments across multiple model families, languages, and 51 knowledge domains show that collateral damage decreases with semantic distance, providing empirical evidence of structured functional dependencies among representations.
Critical strengths
-
An interesting and meaningful research perspective. The paper investigates collateral damage rather than focusing exclusively on target-specific performance degradation. This provides a valuable perspective for understanding the relational organization of representations in LLMs and extends conventional target-centric interpretability analysis.
-
Broad empirical validation across models and domains. The experiments cover multiple model families, languages, and knowledge domains. The consistent relationship between semantic proximity and collateral damage, supported by statistical analyses, provides useful empirical evidence of structured functional dependencies.
Critical weaknesses
-
Insufficient evidence to distinguish the core hypothesis from alternative explanations. Although the paper reports significant correlations between collateral damage and semantic distance, these observations may also arise from shared features, representational overlap, or compression mechanisms. The current experiments do not adequately distinguish these competing explanations. This limitation directly affects the strength of the causal and theoretical claims underlying the proposed SRH.
-
Insufficient validation of the intervention mechanism and its functional implications. The proposed category-conditioned mean substitution differs from conventional attention-head ablation, and the current experiments primarily use random-head controls without systematic comparisons against alternative head-selection or intervention methods. Furthermore, relying mainly on NLL does not fully establish whether the observed damage reflects changes in conceptual understanding, factual knowledge, or relational reasoning. These limitations weaken the methodological justification and functional interpretation of the results.
Questions for authors
-
How can the proposed SRH be distinguished from alternative explanations based on shared features, representational overlap, or compression? Could the authors provide controlled analyses to determine whether semantic similarity remains predictive of collateral damage after accounting for these factors?
-
Since Equation (4) applies a category-conditioned mean shift rather than conventional head removal, how sensitive are the reported findings to this specific intervention? Would zero ablation or standard mean ablation produce similar collateral damage patterns?
-
How does the proposed PMI-based head-selection strategy compare with representative gradient-based, activation-based, or alternative information-theoretic methods? Could the authors clarify whether the observed advantages are specific to PMI-based selection?
-
To what extent do the NLL-based collateral damage patterns correspond to changes in downstream capabilities, such as knowledge question answering, relation classification, or multilingual understanding? Are any task-level results available to support this interpretation?