- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes the hypothesis of semantic fusion and subspace separation in language models, suggesting that semantically related adjacent tokens may form shared representations,thereby hindering the retrieval of individual tokens,and that explicit delimiters can mitigate this interference. The authors validate this hypothesis through controlled experiments using toy Transformers, as well as experiments in both Chinese and English across three large language models. The results indicate that semantically related token pairs are more prone to first-component substitution errors, which can be reduced by the insertion of commas. Furthermore, while blocking early-stage attention pathways improves retrieval performance, it simultaneously impairs arithmetic reasoning capabilities.
Critical strengths
1.The paper proposes an interesting hypothesis connecting semantic composition with constituent-level retrieval interference, offering clear and testable predictions. 2.The experiments across three language models and two languages (English and Chinese) show consistent behavioral patterns, providing empirical support for the proposed predictions. 3.The toy Transformer setup allows explicit control over semantic associations and retrieval exposure, helping investigate the relationship between semantic composition and constituent accessibility.
Critical weaknesses
1.Although the experimental results support the behavioral predictions, the paper does not directly demonstrate the existence of semantic fusion or subspace separation in the models' internal representations. 2.The semantic and random conditions are not fully controlled for factors such as word frequency, token co-occurrence, and lexical familiarity, which may contribute to the observed performance differences. 3.The semantic operator pairs are excluded from retrieval training, making it difficult to distinguish interference caused by semantic fusion from out-of-distribution generalization failures. 4.The use of a post-hoc selected checkpoint for one random seed raises concerns about evaluation consistency. Additionally, the architectural comparison does not isolate the contributions of convolution and linear attention.
Questions for authors
Questions For Authors
-
Direct evidence for the proposed mechanism: Could the authors provide additional analyses, such as linear probing or activation patching, to directly examine whether semantic fusion reduces the accessibility of individual token representations?
-
Potential confounding factors: Would the observed differences between semantic and random pairs remain significant after controlling for word frequency, token co-occurrence, and lexical familiarity?
-
Out-of-distribution generalization: Would similar retrieval errors occur for token pairs that are excluded from retrieval training but are not assigned arithmetic meanings? This would help distinguish semantic interference from generalization failures.
-
Hybrid-model evaluation: Could the authors report results using a consistent checkpoint selection strategy across all random seeds and further isolate the effects of convolution and linear attention?