- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper asks whether frozen, instruction-specific activation directions can improve instruction following without compromising response quality. The authors calibrate one direction per instruction and evaluate both checker compliance and instruction-blind answer quality. The results show that usable directions are rare, while explicit prompting remains a stronger and cheaper baseline in most settings.
Critical strengths
- Composed steering performs no better than the unedited model on the full instruction pool. However, on Gemma-3-27B, directions that work individually also compose successfully, improving joint valid success by 35.0 percentage points over the unedited model. This makes the negative result more informative: steering appears to work only when the individual directions are already reliable. It also shows how evaluating only successful instructions can overstate the effectiveness of steering.
- The human audit suggests that the quality loss is associated with steering itself. Among checker-passing answers, raters rejected 32 of 66 steered responses but only 14 of 58 prompt-only responses. The two arms were evaluated on the same task prompts, with the application of steering edits as the key experimental difference.
Critical weaknesses
- The negative results may stem from the construction of the instructions and the search method. These instructions are of a single source, while the search process covers seven levels and six categories before the detailed screening. If different search methods for the instructions or a broader search scope are adopted, the number of effective instructions may be increased. The paper itself mentions this point, but it cannot be ultimately confirmed.
- The title numbers are largely determined by the set threshold. "The number of usable installations decreased from four to zero" used a success target of 0.80. The paper states that when the threshold was lowered to 0.70, the number of usable installations was two, when it was lowered to 0.50, it was four.
Questions for authors
- Is the low coverage a property of the models, or of the single method used to build the directions? Did you try any other way of obtaining the directions, for example training or optimizing them rather than taking a difference of means? Even a small test on a few instructions would help show whether more instructions become usable under a different extraction method.
- Why does Gemma-3-27B succeed where the other models do not? Do you have an explanation for what makes this model different? And if the success target is lowered to 0.70 or 0.50 so that other models also have members that work alone, do those members combine in the same way?
- What kind of damage does the judge actually catch? The human study asked three separate questions: whether the answer addresses the task, whether it contains wrong facts, and whether the writing is broken. Could you report the results of these three questions separately for the steered answers and for the prompt-only answers? Knowing whether steering mainly produces wrong facts or broken writing would indicate whether the damage can be fixed.
4 comments
Response to Reviewer NAfY (2/2)
Questions
Q1. Is low coverage a property of the models or of the difference-of-means method?
Response: To separate the two, we trained one direction per instruction with the instruction absent from the prompt, optimizing it so that the model reproduces its own compliant answers. Layer search, dose search, test prompts, guard, and judges are the same as in the paper. We ran all 25 instructions on Qwen2.5-7B and 5 on Llama-3.1-8B, giving 30 instruction settings.
If the difference-of-means method were the main limit, trained directions should yield many more usable installations. They do raise compliance: on Qwen2.5-7B, valid compliance rises from 0.09 to 0.97 for the no-comma instruction, from 0.00 to 0.94 for the title instruction, and from 0.04 to 0.92 for bullet lists. Under the guard, usable installations increase from 1 to 7 (Table R1).
Table R1. Mean-difference directions and trained vectors (30 instruction settings).
| Quality filter | Mean difference (paper) | Trained vector |
|---|---|---|
| Guard only | 1 | 7 |
| Guard + Sonnet 5 | 0 | 2 |
| Guard + GPT-5.6-terra | 0 | 1 |
| Guard + both judges | 0 | 1 |
Most of these do not survive the judges. Two pass under Sonnet 5 and one under GPT-5.6-terra, and the setting that passes both is the title instruction on Llama-3.1-8B (0.82 under GPT-5.6-terra). Another 12 settings raise compliance by at least 20 percentage points without becoming usable: 8 stay below 0.80 and 4 exceed a quality bound.
Both factors therefore contribute, but answer quality dominates. The extraction method affects how often compliance is reached, while answer quality determines how many settings remain usable, and this second factor limits coverage for both direction families.
Q2. Why does Gemma-3-27B succeed where other models do not?
Response: On Gemma-3-27B, 5 of 6 guard-usable installations remain usable under the judge, compared with 0 on Qwen2.5-32B and Llama-3.1-70B (Table 1). The difference lies in the cost to answer quality: on Qwen2.5-32B, the two guard-usable installations reach high judged compliance but exceed the validity-loss bound (Section 3). Gemma-3-27B's installations, such as english_lowercase (strict compliance 0.00 → 0.97), reach the target without that cost. We do not claim a general mechanism for this difference, and Section 7 scopes the composition result to "one model and a small selected population." On the second part of the question, lowering the target does not create composable sets on other models, because the added members are all the same instruction (see W2).
Q3. What damage does the judge catch?
Response: We report the three human questions separately. The audit contains 200 answers, 100 per arm, balanced by judge verdict, so the percentages describe this sample rather than population rates.
Table R2. Human ratings by question.
| Question | Prompt only | Steered |
|---|---|---|
| Answers the task: "Yes" | 92% | 78% |
| Answers the task: "Partly" or "No" | 8% | 21% |
| Some wrong facts | 31% | 42% |
| Broken writing | 1% | 5% |
The difference between the arms lies mostly in content rather than form. Among checker-passing answers, wrong facts appear in 42% of steered answers against 22% of prompt-only answers, while broken writing appears in 5% against 0%. Steering therefore mainly causes content drift: answers that address the task only in part or contain factual errors. A surface filter such as the guard cannot detect this, which is why the instruction-blind judge is needed, and it indicates that a fix would have to preserve content, not only fluency.
Raters outside the author team (five lab members, 100 answers) show the same pattern: among checker-passing answers, they find wrong facts in 13 of 34 steered answers (38%) against 6 of 32 prompt-only answers (19%). We have added Table R2 to Appendix K.
We thank the reviewer again for these concerns. The trained-vector experiment shows that a stronger extraction method raises compliance but not usable coverage, the threshold analysis shows that coverage stays below 5% down to a target of 0.50, and the per-question audit identifies content drift as the main quality cost of steering. We respectfully ask the reviewer to consider these results in the final assessment.
References
- Stolfo et al. "Improving Instruction-Following in Language Models through Activation Steering." ICLR, 2025.
Thank authors for the detailed response, it addresses my most concerns. I'll maintain my score.
Thank you
Dear Reviewer NAfY,
Thank you for the positive and constructive review and for your supportive assessment. We are glad that our responses addressed most of your concerns, and we appreciate you maintaining your positive assessment of the paper.
Sincerely,
Authors
Response to Reviewer NAfY (1/2)
We thank the reviewer NAfY for the thoughtful and constructive feedback. We appreciate the recognition of two results we also consider central: on Gemma-3-27B, directions that work individually also compose, improving joint valid success by 35.0 points over the unedited model, and the human audit links the quality loss to steering, with 32 of 66 steered answers rejected against 14 of 58 prompt-only answers. We address the two weaknesses and three questions below, including a new experiment with trained directions.
Note on the revised PDF. New content is in blue. We also rewrote Sections 1 to 5, 7, and 8 for readability. These rewrites are in black and change no result, number, or claim. Some details moved to the appendices.
Weaknesses
W1. The negative results may stem from the instruction source and the search method
Response: The reviewer suggests that a different instruction source or a broader search might yield more usable directions. We examined each factor in turn. The calibration search already spans 7 layers across model depth, 6 coarse doses, and a fine grid of about 16 doses per instance. Each direction is averaged over 80 matched extraction prompts, and re-extracting from four other prompt groups moves composition results by a standard deviation of 0.7 to 1.4 points (Appendix F), so the directions are stable with respect to the prompts used.
For the instruction source, the paper includes 20 IFBench constraint types alongside IFEval. On IFBench, calibration finds no usable installation under either the guard (an automatic filter for degenerate text) or the instruction-blind judge (Section 3).
For the steering method, the paper also runs the rule of Stolfo et al. (2025) in every test cell. It uses the same direction but sets the edit size from the activation rather than a tuned dose. On the four smaller models, it gives the same result as our rule: 4 usable installations under the guard and 0 with the judge. The trained-vector experiment described in Q1 extends this comparison to a different direction family. Across these three configurations, the number of installations usable under both judges stays between 0 and 1.
W2. Headline numbers depend on the 0.80 threshold
Response: The reviewer notes that the "four to zero" result uses a success target of 0.80. The target is applied uniformly to every setting (Section 2), and Appendix E reports the same analysis at lower targets.
english_lowercase(Llama-3.1-8B)english_lowercase(Llama-3.1-8B, Gemma-3-4B)Even at a target of 0.50, 4 of 300 instances (1.3%) are usable with the judge, and at most 13 of 300 (4.3%) under the guard alone. Coverage therefore stays below 5% at every target we tested.
The lower targets also do not change the composition results. Every additional usable installation is the same instruction,
english_lowercase, on a given model, and a set cannot contain the same instruction twice. Lowering the target thus produces no new set to compose.