- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
According to its introduction, this submission aims to analyze how feature directions change depending on context:
a feature direction identified in one input context may not transfer directly to another (line 64)
We ask whether this context dependence has shared structure: when the information under study takes multiple values, do the corresponding directions change according to a common rule as one moves between contexts? Can a rule learned from some values predict directions for the remaining values? (lines 69-72)
The submission studies this issue in a simple arithmetic setting in which two numbers are added. Prior work has found that number values can be probed with high precision in such a setting, but causal interventions aiming to steer model output to counterfactual sums have proven more difficult. The paper positions itself as demonstrating an effective steering method for number representations.
Critical strengths
Within its narrow experimental scope, the proposed method is effective for steering number representations in LMs. More generally, studying potential regularities in how context affects feature directions is an interesting research direction.
Critical weaknesses
-
The submission's framing doesn't fit its content. In contrast to the expectations raised by the introduction, the experiments are not concerned with context, but what the authors call "conditions", which are simply the ones and tens digits of the addends. There may be a sense in which the digits of the addends can be the "context" of the addition, but that is not how the word is commonly used.
-
The contributions are too thin. While precise steering of number representations on a single prompt is a focused contribution, this is not enough for a long paper at a top tier conference. To make this a stronger submission, the authors could, for example, demonstrate that their Procrustes-based method for transferring edit vectors across contexts (or conditions) works in other settings or on other tasks.
-
It is possible that I missed other contributions, but the empirical part of the paper is an agglomeration of statements without much apparent structure to guide the reader. To give only two examples out of many, a typically report of results looks like like
5.3 GENERALIZATION ACROSS VALUES HAS A MODEL-SPECIFIC LAYER RANGE Canonical interventions yield complete target-answer match rates of 94.78%–99.43%
without any apparent relation to the preceding context, making it difficult to understand how this fits into the paper's overall narrative. Another common issue are sentences like
The comparison with Common-GPA tests whether powers of one operator can retain the output effects of condition-specific frames in the same common basis. At Llama L21, Step-power and Common-GPA yield similar match rates (99.21% and 99.10%) with 66 and 594 continuous transfor- mation degrees of freedom, respectively, illustrating that a more compact description can preserve the observed output effects at this layer
This hyper-precise scoping of claims might be valued by AI reviewers, but catastrophically lowers the signal-to-noise ratio for human reviewers.
Questions for authors
none