- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies which attention heads mediate information transfer from a context to a fixed query. It adapts desiderata-based masking to replace context keys and values at query positions, learns task-specific sparse masks, and aggregates their rankings into a shared set of 20 heads, ICL20. Experiments primarily use Llama-3.1-8B-Instruct, with an additional Llama-3.2-3B study. The authors report cross-task ablation effects, investigate evidence transfer and label mapping using larger masks, and propose task-dependent roles involving source selection, relational representations, and chat-template anchors.
Critical strengths
-
The effects extend beyond the tasks used to identify the heads. ICL20 is selected using persona, affect, and reading-comprehension tasks, but ablating it also hurts translation, copying, synthetic sequence tasks, and free-form QA. For the 8B model, retrieval accuracy drops from 0.89 to 0.08 and rule-inversion accuracy from 0.85 to 0.13 in Section 5.2.1. Figure 4 shows a similar broad pattern for a separately identified set in the 3B model. This is an interesting result because the heads appear to matter for more than the particular tasks used to find them.
-
The label-remapping experiment helps separate using evidence from choosing an output label. In Appendix B.1.1, the evidence mask can change the model’s answer while leaving it in the original Yes/No vocabulary. Adding 49 Ba/Ga-specific heads in layers 16–31 increases the rate of correct new-label answers from at most 0.1% to 89% on the Ba/Ga joint-intervention pairs, and the effect also transfers to Portuguese and French labels. This gives a concrete indication that carrying contextual evidence and mapping the answer into the requested vocabulary involve partly different sets of heads.
Critical weaknesses
-
I am not yet convinced that the experiments isolate context transfer in the fixed ICL20 set. The discovery procedure replaces context K/V at query positions, but the main evaluation in Section 5 zeroes whole head outputs. This can also disrupt other computations those heads perform. Meanwhile, the high-IIA results and the label-remapping and multilingual experiments use task-specific masks, often with roughly 120 heads, rather than the exact 20-head aggregate. I could not find held-out IIA results for that fixed set, or a control that separates its context-to-query contribution from its other connections. The ablation results show that these heads matter across tasks, but they do not yet show that the damage comes specifically from removing contextual information. The same issue applies to the chat-anchor interpretation: attending to markers and causing errors when ablated does not establish what information the heads read from those markers.
-
I would have expected a direct comparison with function-vector heads. Todd et al. [1] already identify a small shared set of heads by averaging causal effects across ICL tasks. Yin and Steinhardt [2] compare FV and induction heads across 12 models and find FV heads more important for few-shot ICL, especially in larger models. The paper cites both, but Sections 4–5 only compare ICL20 with token copiers, concept copiers, and retrieval heads. Restricting the intervention to context K/V is a meaningful methodological change, but a different way of finding heads does not necessarily identify a different mechanism. Measuring overlap and comparing equal-sized head sets under the same interventions would help establish what ICL20 adds to the existing picture.
[1] Eric Todd, Millicent L. Li, Arnab Sen Sharma, Aaron Mueller, Byron C. Wallace, and David Bau. Function Vectors in Large Language Models. ICLR, 2024.
[2] Kayo Yin and Jacob Steinhardt. Which Attention Heads Matter for In-Context Learning? ICML, 2025.
Questions for authors
-
What held-out IIA does the exact, fixed ICL20 set achieve under the Section 2 intervention? Do the large QA effects persist when intervention is restricted to its context-to-query contributions, rather than zeroing whole head outputs? This would clarify whether the main result is transfer-specific or reflects broader head importance.
-
How much does ICL20 overlap with the top 20 FV heads in each model, and how do their intervention effects compare on the same evaluation examples? A distinct effect, including after accounting for shared heads, would materially strengthen the claimed contribution.