- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper studies when linear self-attention can do more than behave like a sequence of fixed preconditioned gradient-descent steps. The main theoretical result is that, for arbitrary one-layer LSA parameters, the effective bilinear preconditioner is fixed across contexts, while unrestricted two-layer LSA can make the effective preconditioner depend on the empirical covariance. The two-layer model can then represent a richer class of context-dependent updates. This is better than just conducting two fixed steps on the distribution. The paper then introduces an update-kernel-based diagnostic to measure this behavior in trained models and tests it across LSA, softmax attention, classification, and associative recall.
Critical strengths
The best part of this paper is the formalization of the cross-layer effect. The theory is quite clean and the empirical tests are well matched to the theorems. I think this way of presenting the problem is nice and the intuition behind it can be possibly used in future theory to explore how transformers behave.
The update-kernel analysis is quite nice. It's a very mechanistic way to ask how much a trained model departs from its fixed bilinear update. The ablations are appropriate and fairly convincing mostly. Bypassing or randomizing the second layer does seem to remove the measured effect while applied to LSA.
Critical weaknesses
(1) I think the biggest problem is how the novelty with respect to prior work is framed. The main idea that multiple linear transformer layers can interact to implement something richer than standard preconditioned gradient descent is already present in the literature. Ahn et al., “Transformers Learn to Implement Preconditioned Gradient Descent for In-Context Learning,” already study “multi-layer transformers beyond standard optimization methods” and analyze a more general parametrization. Vladymyrov et al., “Linear Transformers are Versatile In-Context Learners,” directly establish that cross-layer interaction can make the optimization rule adapt to the current context. The novelty of this paper seems to be more specific regarding the exact separation. This paper does briefly mention the Vladymyrov paper, but in a very limited capacity.
So if I am not mistaken, this paper does not really establish for the first time that multiple layers provide richer context-dependent optimization. Rather, it shows that the unrestricted two-layer LSA is strictly richer than the corresponding class of fixed preconditioned steps, while one layer cannot realize the same covariance-dependent preconditioning. The problem is that this exact effect is not what is shown for softmax. We do not see the same sharp separation, but rather a gap becoming positive at layer two. So the exact novel result does not transfer, while the broader qualitative intuition does. However, as mentioned above, the broader intuition seems to be the part that is less novel.
(2) The second major problem is that there is limited analysis of why this specific result actually matters. The paper basically provides a clean separation in unnormalized LSA, establishes it carefully, and has a brief discussion of how related behavior partially transfers to other settings. However, it is not really clear what this tells us about standard transformers, what broader mechanistic conclusion should follow from it, or how this should motivate future work or architecture design.
I am left unsure whether this is an important contribution to our understanding of transformers more generally, or mainly the correct statement of a specific mathematical property of unnormalized LSA. This is especially important because the broader intuition that deeper layers can implement richer context-dependent optimization is already present in prior work.
Questions for authors
(1) Could the authors clarify more precisely what they view as the main novelty relative to Ahn et al. and Vladymyrov et al.? My current understanding is that the new contribution is specifically the minimal-depth/strict-separation result rather than the broader idea of richer cross-layer optimization.
(2) Which part of the theoretical result do the authors expect to carry over beyond unnormalized LSA? In particular, how should the softmax results be interpreted relative to the sharp LSA separation?
(3) What broader implication do the authors see coming from this result? In particular, what does the separation tell us about understanding or designing more realistic transformers?
3 comments
I appreciate the more precise characterization of the novelty and the additional empirical comparisons. However, I am still not convinced that establishing this particular depth separation in unnormalized LSA gives us a substantially new understanding of transformer depth, since prior work has already shown that cross-layer interactions can lead to richer, context-dependent optimization.
I do think the proposed diagnostic and fixed-step comparisons are useful contributions, but I am not yet convinced that these, together with the specific theoretical separation, are sufficient to establish the broader significance of the paper. I therefore intend to maintain my current score.
Thank you for the reply and for stating your remaining concern clearly.
We agree that prior work shows that layers can interact to produce richer, context-dependent optimisation. We also agree that the separation in linear self-attention is a specific result on its own.
Our claim about transformer depth rests on the two parts that you describe as useful. Prior work shows that such updates exist. It does not test whether a trained model computes one, against every sequence of the same number of fixed steps. The revised paper does, with two findings.
- Trained two-layer LSA models compute an update that two fixed steps cannot produce (Table 2).
- This is not specific to unnormalised LSA. In a standard softmax transformer, a single layer already outperforms two fixed optimisation steps (Section 8 and Table 3).
Reading each layer as one optimisation step therefore undercounts the layers of a standard transformer. The framework only needs a model's predictions, so it applies to any transformer.
If a specific result would establish the broader significance for you, please tell us.
Thank you for your review and summary of the paper. We answer your questions in order.