- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The article asks whether an intervention for controlling the linguistic grammar of a string output by a language model can be stacked with another such intervention. I.e., to what degree the individually learned patches for controlling the grammar can be combined. To judge this, a synthetic dataset is proposed. These are evaluated by looking at the predictions of the language model. Validation is done on natural language (e.g. number and tense) and synthetic examples (also negation, active to passive, object swap). The authors find that the interventions (using activation patching) can be less reliable when combined (sequentially through a grammar-specific projection) than on their own. An abstract counterexample to the patches working together is also given. A proof is given for a bound on the error from stacking patches under strict conditions.
Critical strengths
None
Critical weaknesses
The paper is hard to follow. I could barely understand the abstract and the introduction (bar its first paragraph) when first seeing them. Terms are used without having been introduced, and the flow is confusing (see e.g. the start of the third paragraph of the introduction: “A finite counterexample shows why reuse needs testing.” Counterexample of what? Why finite? What is being reused? Why test?). The methodological chapter is not much better; it starts with a claim about OpClosure and some properties said to toggle things, except it is not clear what OpClosure is yet (it’s referenced in the introduction and abstract but would like to see it introduced properly), nor what it means to toggle something. Or at the start of 3.2. “Sequential reuse generates a domain of reached activations.” There is so much context missing that reading the paper becomes detective work.
There is also a worry about the novelty. Many previous works do patching, and datasets like CausalGym have grammatical settings. See e.g., the papers you cite (Todd et al. 2024) who apply grammatical patches for tense and number in combination with steering to pick a word, and (Klerings et al 2025) that compare tense and aspect, no direct comparisons are made to these methods. Two others that are not cited (Brinkmann et al, 2025 and Hendel et al 2023) that steer grammatical properties. Besides the linguistic grammar there are many other works on steering and patching, that do stack and consider impacts thereof, e.g. ReFT (Arora et al, 2024) and pyvene (Wu et al 2024) – the last of which you point out already in appendix K.
Questions for authors
Given how crowded this field is I'd like to understand better what your protocol specifically reveals that prior work does not do? (I.e. is there anything that changes that we thought otherwise about or tells us something new, and why did existing evaluations miss this, and could this not have been checked with existing datasets like CausalGym or adaptions thereof?)