- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how to reproduce the behavior of an existing activation intervention with a smaller hidden-state modification. It provides theoretical analyses of directional optimization, shared module capacity, and the cost of preserving additional behaviors. Based on these insights, the authors propose MFM, which matches reference outputs while minimizing intervention magnitude. Experiments on two LLMs and three reasoning benchmarks show an average 57.6% reduction in intervention cost with little loss in answer fidelity.
Critical strengths
-
The distinction between pointwise optimal interventions and shared realizability is interesting. The theoretical analysis provides useful insights into how model capacity and context variation affect intervention compression.
-
The experiments show substantial reductions in intervention cost while largely preserving the reference behavior. The comparisons with scalar scaling and coordinate gating are helpful.
Critical weaknesses
-
The methodological novelty is somewhat limited. The main optimization resembles output distillation with norm regularization, while several theoretical results rely on standard ridge regression, projection, and low-rank approximation. Related works on steering geometry and minimum-distortion interventions have explored similar ideas. The paper could better explain what is fundamentally new beyond these existing approaches.
-
The evaluation is quite narrow. The experiments mainly preserve normalized answer distributions on multiple-choice tasks. It is unclear whether the savings would remain when preserving full output distributions or free-form generation. Also, the reduction in hidden-state displacement does not necessarily translate into lower computational cost.
Questions for authors
-
What is the main theoretical difference between MFM and existing geometry-aware or minimum-distortion steering methods? Could you provide a more direct comparison?
-
How much of the reported compression comes from redundancy in the initially trained reference intervention? Would the gains remain as large with a more strongly norm-regularized reference?
-
Would MFM still achieve substantial savings when matching full-vocabulary output distributions rather than only multiple-choice answer distributions?