- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In earlier work on creating function vector such as work by Todd et al., 2024 selects heads for function vectors based on the individual head importance and neglect the interaction between heads. The paper proposes a novel method Conditional Ordering through Removal Evaluation for Function vectors (CORE-FV) to select heads such that the interaction between heads are captures into the function vectors. CORE-FV works as a deletion based method where it starts with the full set of heads, delete the least-affecting-the-task heads, re evaluate the heads in the new remaining head context and continue this cycle. The paper shows that the CORE-FV (function vectors) does well on composite tasks where interaction between heads is required. The proposed method has also been evaluated against earlier baselines on multiple model scale and seeds.
Critical strengths
-
I think CORE-FV is an interesting idea and well motivated on making function vector much richer capturing dependency of attention heads which allows the models to do well on composite tasks and will be very valuable to the community in continuing the work on function vector for more complex tasks.
-
The results are convincing on both the Function Vectors benchmark as well as on composite tasks. The average gains over AIE are beyond seed standard deviation and consistent across all model scale except MIstral-7B-v0.3 where CORE-FV is closer to AIE. On composite tasks CORE-FV gains are clearly evident improving over AIE relatively by ~40% on GPT-J-6B and over 100% relatively on Llama-3.1-8B.
-
The paper also discusses the feasibility of the method and introduces group deletion to bring O(H^2) evaluation down to O(H) evaluation.
-
The paper is very well written, easy to follow with sufficient details on method, experimental setup and results.
Critical weaknesses
-
Does group deletion of heads change the quality of the heads? What is the trade-off between doing single-head deletion versus group head deletion? Which one was used in the analysis?
-
In Table 3, each earlier work in Todd et al., 2024 didn’t use a coefficient, and as CORE-FV uses one, it is hard to compare whether the gains are due to the coefficient or a different head selection method.
Questions for authors
- For composite tasks (table 2), what is the reasoning behind the model choices for evaluation?
2 comments
Thank you for addressing the questions and adding new results. I will retain my positive score.
Additional Ablations, Coefficient Analysis, and Expanded Model Evaluation
We thank the reviewer for their thoughtful feedback and positive assessment of our work. Below, we address the two concerns and the question about model choices, highlighting the additions to the revised manuscript.
W1. Trade-off between Adaptive Group Deletion and Single-Head Deletion
Adaptive group deletion was used in all main analyses.
To directly assess its effect on selection quality, we added a controlled comparison with single-head deletion in Section 4.5, covering GPT-J-6B and Llama-3.1-8B on Antonymy and English--French across three seeds. Adaptive deletion reduces runtime by 16--19$\times$ on GPT-J and 44--48$\times$ on Llama, while maintaining comparable accuracy. This supports our default schedule as a substantial computational saving with modest, task-dependent accuracy changes. Time constraints limited this additional experiment to two tasks, and we are happy to extend the single-head ablation to all tasks in the final version.
Entries are mean ± sample standard deviation across three seeds. Times measure head selection only, including preparation and complete ranking, but excluding model loading and downstream tuning and evaluation. Runs use NVIDIA T4 GPUs.
W2. Contribution of Coefficient Tuning in Table 3
We agree that the original comparison did not clearly separate the contributions of head selection and coefficient tuning. We have added a fixed-α=1 variant to Table 3, setting all three component coefficients to one, with no coefficient tuning. Using the same 10 heads per component, it achieves 47.01 ± 3.56% average accuracy across eight tasks, compared with 43.25 ± 9.16% for component-specific coefficients and 42.88% for the published Sum FV result. These results show that CORE-FV supports composition without coefficient tuning. The comparison with published FV is approximate, since Todd et al. (2024) may use different seeds and the code for their composition experiments is not publicly available.
Several tasks show substantial variation across seeds in both the fixed-α and component-α settings. Our task-specific heads are reselected across seeds, whereas the original FV setup uses a fixed global head set; this may contribute to the variation. Refining coefficients on the composed task's validation split increases average accuracy to 64.50 ± 0.39%, with much lower variation in the average across seeds. These results show that coefficient refinement contributes substantially to the strongest composition result, so we do not attribute that gain solely to head selection. The controlled evidence for head selection comes from our matched AIE comparisons in Tables 1 and 2, where both methods use the same coefficient-selection procedure.
Q. Why Were Composite Tasks Initially Evaluated on Only Two Models?
GPT-J and Llama were our initial main models. We expanded the standard-task evaluation to additional models later, while the composite experiments initially remained limited to those two; there was no methodological reason to restrict them. In the revision, Table 2 now covers all five models, adding Qwen3-4B-Base, Mistral-7B-v0.3, and OLMoE-1B-7B. The trend holds across the added models: CORE-FV improves average composite-task accuracy by 15.44--40.27 percentage points over AIE and 24.38--35.19 points over LTV.