- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether matching local measurements is enough to guarantee similar effects when interventions are applied at a finite scale inside a language model.
The proposed FINITEFIBER audit constructs different activation interventions that match a specified set of local measurements within numerical tolerances. These measurements include residual norms, directional derivatives, calibration energies, and, in the stricter setting, a directional second-order term. The experiments show that matched interventions can still differ in their mean log probability per token for the complete target answer.
A separate experiment in a shared eight-dimensional intervention family shows that aggregating gradient measurements can lose information needed to distinguish candidates. Keeping positionwise measurements restores exact identifiability in this family.
Critical strengths
1.The paper goes beyond a general intuition about the limits of local measurements by directly constructing matched control interventions. It separates candidate construction, constraint verification, and finite-effect evaluation.
2.The experiments provide stronger evidence than a simple failure of first-order approximation. The stricter setting also matches a directional second-order term and uses tighter calibration-energy tolerances.
3.The shared-family experiment clearly demonstrates information loss from aggregation and the value of retaining positionwise measurements.
Critical weaknesses
1.The conceptual novelty beyond the known limits of local information in nonlinear functions is not sufficiently clear. Although the matched-control audit is carefully designed, the paper could better explain what new insight it provides beyond this general principle.
2.The interventions in Section 3.1 are deliberately constructed and substantially separated. The reference residual is amplified after projection, and the control is constrained to be orthogonal to it. These choices raise questions about how well the findings apply to realistic model edits, especially interventions implemented through shared weight changes.
3.The main confirmation under the strict matching profile is limited to Qwen2.5-3B at one layer and with one editing setup. Although the appendix includes experiments on other models, they do not directly replicate the main strict-profile result. Evidence for the generality of this result therefore remains limited.
Questions for authors
N/A