- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper makes a distinction between restricting which parameters get updated and restricting gradient propagation through downstream layers. It proposes FP-TRM, which selects and weights documents so as to increase an attention head’s ablation-defined contribution using a small head-only update. Experiments compares full and selective differentiation on Pythia-1B and evaluates the full method on Pythia, OLMo-2, and Qwen3.5.
Critical strengths
The matched path experiment isolate a meaningful implementation issue. For identical deployed updates, full-path predictions correlate with the measured responses at 0.9904 and 0.9999, compared to 0.3495 and 0.7334 for selective predictions at the two heads tested.
The intervention comparisons controls update magnitude and uses held-out text. Full-path actions beat selective-path actions in all ten target–corpus–route conditions, with positive multiplicity-adjusted lower bounds.
The paper is transparent about its limitations, including losses against OMP and GradSim, comparison counts that are conditional rather then independent, and cases where increasing head contribution actually makes output prediction worse.
Critical weaknesses
The methodological novelty is limited compared to how broad the presentation is. Proposition 1 follows directly from the standard Taylor remainder bound, and FP-TRM combines full differentiation with existing gradient matching. The strongest isolated finding is about one particular selective-backward implementation at two heads in a single Pythia-1B checkpoint; the other architectures dont repeat that matched path comparison.
The behavioral significance of the objective is still unclear. Contribution is measured while an upstream carrier head is forcibly ablated, so increasing it does not neccessarily improve the intact model’s computation. In the Qwen replay experiment, FP-TRM drops from third to eighteenth out of 19 actions at the higher dose, and none of the six reported output-gain lower bounds are positive (Tables 8–9). This limits the shown usefulness beyond optimizing the chosen internal score.
The broad baseline comparisons change several factors at once. MDA uses an unablated query and equal positive document weights, while FP-TRM uses carrier-conditioned fitting, optimized weights, and possibly negative coefficients (Section 5.1; Appendix G.4). These comparisons can’t isolate the benefit of full-path differentiation. In the more closely matched OMP comparison, FP-TRM gets three wins, three ties, and four losses in mean response on Pythia-1B (Table 3).
Questions for authors
Does the full-path advantage hold up across more independently selected heads and architectures under the same matched backward-path experiment?
Does optimizing carrier-conditioned contribution improve an independently defined mechanism behavior when the carrier is left intact?
How much of the advantage remains when MDA and FP-TRM share the same query context, coefficient constraints, and support-search procedure?
Thank you for your detailed comments. To test response prediction and behavioral transfer, we evaluated six additional heads under MDA-style controls and measured copying with the carrier intact. Full-path derivatives predict the same updates more accurately at every head, while the copying results establish transfer of many contribution-based actions to intact-model behavior.
Q1: Does the matched result extend to more heads and architectures?
Full-path prediction is more accurate at all six added Pythia-14M and 31M heads. The matched derivative evidence spans these Pythia models, while OLMo-2 and Qwen test the complete intervention across architectures. We retained each model's original MDA head coordinate and chose two further heads by prefix-matching scores on 64 independent sequences, before measuring path differences or outcomes. Both derivatives predict the same 16 fixed head-only updates at relative norm 3×10−4.
Full-path correlations exceed 0.999 at all six heads, compared with 0.858–0.965 for selective differentiation. Full-path RMSE is also 99.1%–99.6% lower. The added heads include H0, H1, H3, and H6 in layers 3 and 4, broadening the controlled finding beyond two H4 targets.
Q3: What remains when query, coefficients, and support search are matched?
Full-path differentiation still reduces response-prediction error and changes document selection when the MDA query, coefficient constraints, and search rule are matched. Both paths use the released MDA probe, shared QKVO EK-FAC geometry, 256 candidate documents, and identical query contexts, positive equal weights, and top-ten selection rules. Top-ten overlap is 30%–90% across heads, alongside the prediction improvements above. Associated actions always deploy ordinary full-path document-loss gradients, so the attribution path changes document selection while preserving the update definition.
Full-path FP-TRM also yields larger contribution increases in all ten matched Pythia-1B conditions. Both paths share the contribution query, candidate pool, coefficient-family rule, support-search procedure, and update norm. All ten target–corpus–route contrasts have positive multiplicity-adjusted bounds. These matched comparisons isolate differentiation. The broader adapted-MDA comparisons instead assess the complete action constructions, including their different queries and weighting rules.
OMP remains competitive as a support solver under the corrected gradient. With matched target and geometry, Pythia-1B gives three higher means, three identical actions, and four lower means for FP-TRM. Thus the derivative finding supports using the correct response gradient with gradient matching, including OMP as a support solver.
Q2: Does contribution optimization improve behavior with the carrier intact?
Carrier-conditioned actions improve intact-copy log probability in 11 of 12 tests, with simultaneous 95% confidence intervals above zero. We evaluated six heads with both attribution paths, using equal positive top-ten actions at the common dose above. The carrier remained intact during all behavior measurements. Evaluation used 256 held-out copy sequences and 128 natural-text examples. Eleven of twelve no-carrier fitting actions also improve copying, and all 24 natural-text mean losses decrease slightly.
Contribution prediction measures the targeted internal intervention, while intact-copy gains measure its behavioral consequence. Across the twelve full-versus-selective copying comparisons, full is higher in two, selective is higher in eight, and two are unresolved under the simultaneous intervals. For example, at 14M L3H3, full-path selection produces a larger internal-contribution increase, while selective selection produces a larger intact-copy gain. Thus the new experiment establishes behavioral transfer for many actions and directly measures which objective each comparison supports.
The Qwen replay similarly shows that contribution gain is an objective-specific effect. Its higher-dose contribution increase accompanies a negative output change and rank 18/19, while the primary-dose output rank is 3/19. None of its six output-gain lower bounds is positive. Accordingly, output improvement is established by independent output measurements, and the contribution score answers the specific conditional mechanism question.
What is the methodological contribution beyond Taylor expansion?
Our contribution is to identify and measure the response error caused by selective differentiation under a fixed intervention. Proposition 1 expresses that error as an omitted first-order projection plus the standard second-order remainder. FP-TRM then uses established gradient matching to turn the complete response gradient into document-based actions. The matched experiments demonstrate the practical consequence of this distinction while holding the intervention and fitting choices fixed.