- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper studies algebraic and geometric aspects of simplified attention mechanisms. The results include a comparison of the linear spans of attention scores under different simplifications of the attenations mechanisms, a width lower bound to compute pairwise inner products with feedforward networks with quadratic activation function as well as an analysis of the polynomial degrees in simplified residual attention architectures. Moreover, bounds on the Betti number of decision boundaries using Milnor-Thom are derived.
Critical strengths
The paper provides several sound and concrete mathematical claims about simplified attention networks. I also appreciate that the authors distinguish the results on their simplified models with transformer thereby avoiding potential misinterpretations.
Critical weaknesses
My main concern is that the paper appears to present a collection of rather elementary statements without a clear story and I find it difficult to identify a substantial new contribution.
For instance, the strict inclusions between the spans of different attention simplifications in Proposition 3.1 follow quite directly from the distinction between linear and nonlinear functions. Similarly, the lower bound in Theorem 4.2 essentially follows from the linear independence of the target quadratic forms, together with a simple trace argument, while the upper bound uses a polarization identity.
Moreover, the discussion of the geometry of ReLU networks feels somewhat out of place, since on one hand it is not connected to the remaining paper and it is also just a summary of very well-known facts.
Finally, I could not make a lot of sense of the topological lottery ticket conjecture. The paper says that "we conjecture that a randomly initialized attention model may already contain local portions of token decision surfaces that training can move toward useful class boundaries". It is not clear to me, what is conjectured, based on what evidence and what about this conjecture is topological and specific to transformers.
Questions for authors
- What do the authors consider the main mathematical contributions and/or message of this paper?
- Could you clarify what the topological lottery ticket conjecture is saying and based on what evidence you are conjecturing it?