- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper aims to explain, through a gradient-flow analysis, why attention concentration and attention sinks emerge during training even when concentrated attention is not necessary for solving the task. It considers a task with a shared, input-independent target and shows that, under a particular initialization, training the value map and the merged query–key matrix reduces exactly to learning position-specific logits and value vectors. For the reduced model, it shows that attention converges to a single position under logistic loss, and that attention becomes increasingly polarized under additional conditions for square loss and other losses. The paper further analyzes a setting in which multiple queries concentrate their attention on the same position and discusses its connection to attention sinks. It also explains theoretically how normalization induces competition between positions, and shows empirically that normalization promotes sink formation even with attention functions other than the exponential.
Critical strengths
The paper analyzes how the joint learning of values and attention leads to attention concentration in several settings: concentration on a single position under logistic loss, attention polarization under square loss and other losses, and competition between positions induced by normalization. Together with experiments using attention functions other than the exponential, these results examine the mechanism of concentration from several angles.
Critical weaknesses
The theoretical analysis considers a restricted setting, and its significance for explaining attention sinks in realistic models is not sufficiently clear. The paper uses a shared, input-independent target and a special initialization to reduce training to the direct learning of position-specific logits and value vectors. While it usefully clarifies how interactions between values and attention amplify initial differences, I have reservations about how much new understanding of attention sinks is gained from this analysis in such a restricted setting.
Questions for authors
Why are different initializations used for logistic and square losses? Can the attention-concentration results for each loss also be obtained under a common initialization?