- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper argues that adding a vector while the model processes a prompt is a different intervention from adding it while the model generates a response, so the direction should be designed for the intended setting. The paper then introduces Operator-Conditioned Gradient Steering (OCGS), which obtains directions for every layer and operator in one backward pass by aggregating the gradient of a likelihood contrast between the target model's own high- and low-scoring responses over the positions the chosen operator writes to. Across three models and six behaviours, matching direction extraction to deployment yields the strongest aggregate behavioural control.
Critical strengths
- Clear formulation with direct empirical support
The paper treats the intervention operator as part of steering-direction construction. Table 2 test extraction-deployment compatibility: matched directions achieve the highest reported mean behavioral improvement under every operator across all three models. Operator-matched BiPO shows the same pattern on Llama for two behaviors, suggesting that the principle extends beyond OCGS.
- Efficient extraction with careful implementation
One backward pass per minibatch supplies gradients for all candidate layers and operators. The appendix clearly specifies boundary handling, gradient signs, and normalisation. Reported vector-construction times are substantially lower than BiPO's, although they exclude rollout generation and layer selection.
Critical weaknesses
- Uncertainty in the main results is not quantified
Table 1-2 lacks reported confidence intervals or run-to-run variability, which matters because some differences are very small. Capability results are also averaged across behaviors, potentially hiding uneven degradation.
- Local guarantee is not sufficiently validated at deployment.
Optimality applies to a linearized, teacher-forced likelihood objective, whereas evaluation measures freely generated behavior at a single strength, . Strength sweeps and approximation-error measurements are needed to establish robustness.
Questions for authors
- Can you report confidence intervals and run-to-run variability for Tables 1-2, plus capability sample sizes and per-behavior results?
- Does the matching advantage hold across steering strengths, and how well does the first-order prediction track actual gains?
4 comments
Response to Reviewer G6uC (2)
Weakness 1 and Question 1 [ Part 2/2 ]
(2) Averaging procedure and performance preservation in general capabilities
Regarding capability preservation, our experiments examine both overall performance and changes in model capabilities under different behavioral steering conditions. Since our experiments cover three models, six behavioral dimensions, three deployment operators, and four capability benchmarks (IFEval, GSM8K, CSQA, and MMLU), reporting every combination individually in the main text would result in excessively large tables and make it difficult for readers to grasp the overall findings.
Therefore, in main-text Table 1, we report the average capability changes across behavioral dimensions and capability benchmarks. This metric summarizes a large number of experimental configurations with relatively high information density, allowing readers to directly compare overall capability preservation across different models, methods, and deployment operators. Meanwhile, to preserve the information from individual capability benchmarks, we have separately reported the results for IFEval, GSM8K, CSQA, and MMLU in Table 6 of Appendix C.5.
Furthermore, to directly address your concern that averaging across behaviors might hide localized performance degradation, we supplement the results of capability changes broken down by individual behavioral dimensions. The following table provides an example using the OCGS-All configuration on Qwen3.8-27B.
| Target Behavior | IFEval | GSM8K | CSQA | MMLU | Avg. Capability |
|---|---|---|---|---|---|
| Extraversion | −0.13 | +0.05 | +0.10 | +0.03 | +0.01 |
| Neuroticism | −0.35 | −0.08 | +0.05 | −0.05 | −0.11 |
| Humor | −0.08 | −0.06 | +0.04 | −0.02 | −0.03 |
| Deception | −0.55 | −0.18 | −0.11 | −0.12 | −0.24 |
| Sadness | −0.18 | +0.02 | +0.08 | +0.05 | −0.01 |
| Sycophancy | −0.46 | −0.10 | +0.04 | +0.01 | −0.13 |
As shown above, the per-behavior results further show that OCGS can achieve effective behavioral control while generally preserving the model's general capabilities.
Thank you again for the comment. We hope that the additional uncertainty analyses, bootstrap confidence intervals, and per-behavior capability results provide a more comprehensive picture of OCGS's behavioral-control advantages and general capability preservation, making the experimental conclusions of our paper clearer, more rigorous, and more reliable.
Weakness 2 and Question 2 [ Part 1/2 ]
Thank you for this comment. Specifically:
(1) First-order optimality and its approximation accuracy under finite interventions
First, we would like to clarify that the first-order optimality established in our paper is a local optimality result obtained by linearizing the operator-conditioned teacher-forced likelihood objective at the zero-intervention point () (Eqs. 13–14). Specifically, under a fixed perturbation budget, the normalized gradient gives the steering direction that maximizes the gain of the linearized objective.
To examine the accuracy of this local approximation under finite intervention strengths, we further compare the first-order linear predicted gain () with the actual gain in the teacher-forced likelihood contrast, recomputed after applying the steering vector (). We define the relative Taylor approximation error as:
\frac{ |\Delta J_{\mathrm{actual}}(\alpha) -\Delta J_{\mathrm{linear}}(\alpha)| }{ |\Delta J_{\mathrm{linear}}(\alpha)| }\times 100\%.$$ We evaluate this approximation error under different relative intervention strengths for all three deployment operators (Prefill, Decode, and All). The results are reported in the following table. | Relative Strength | Prefill | Decode | All | |:---|---:|---:|---:| | 4% | 4.2% | 5.1% | 6.0% | | 6% | 7.3% | 8.2% | 9.4% | | 8% | 11.2% | 13.0% | 14.7% | | 10% | 17.5% | 19.4% | 21.6% | | 12% | 25.1% | 28.0% | 30.8% | | 16% | 41.0% | 45.5% | 49.3% | *Each cell reports the average relative Taylor approximation error across the three behavioral dimensions.* The results show that the approximation error between the actual objective changes and the first-order linear predictions gradually increases with intervention strength, consistent with the theoretical expectation that higher-order terms affect the local linear approximation. At the default strength of 8% used in the paper, the approximation errors for the three operators are 11.2%, 13.0%, and 14.7%, respectively, all remaining below 15%. This indicates that the first-order approximation can still reasonably characterize the changes in the actual likelihood objective within this operating range.Response to Reviewer G6uC (3)
Weakness 2 and Question 2 [Part 2/2]
(2) Practical deployment robustness under different intervention strengths
To further verify the effectiveness of the first-order optimal directions in free generation, we conducted an additional Steering Strength Sweep experiment. On Qwen3.8-27B, we selected three behavioral dimensions, Extraversion, Humor, and Sadness, and tested all three deployment operators, Prefill, Decode, and All. We expanded the relative intervention strengths from the original 8% to 4%, 6%, 8%, 10%, 12%, and 16%.
In these experiments, we fixed the original OCGS steering directions, intervention layers, and evaluation prompts, changing only the relative intervention strength (). We used the same free-generation settings as in the main paper and employed the Qwen3.8-Max judge to evaluate actual behavioral performance and response quality.
Table R5: Steering Strength Sweep under Different Intervention Operators. Each cell reports Avg. Behavior Base [Quality Base], representing the average behavioral gain and average response-quality change across the three behavioral dimensions, respectively.
| Relative Strength | Prefill | Decode | All |
|---|---|---|---|
| 4% | 2.36 [−0.03] | 2.20 [+0.02] | 2.62 [+0.03] |
| 6% | 3.21 [+0.05] | 3.14 [−0.07] | 3.63 [−0.04] |
| 8% | 3.63 [+0.12] | 3.71 [−0.05] | 4.25 [−0.11] |
| 10% | 3.77 [+0.03] | 3.84 [+0.01] | 4.39 [−0.21] |
| 12% | 3.82 [−0.12] | 3.88 [−0.18] | 4.43 [−0.38] |
| 16% | 3.68 [−0.38] | 3.74 [−0.46] | 4.27 [−0.70] |
The experimental results show that OCGS achieves effective behavioral control at all tested intervention strengths. In particular, behavioral gains remain stable around 8%. Further increasing the intervention strength can bring additional behavioral gains, but also leads to more pronounced degradation in response quality. For example, at 16%, the average response quality decreases by 0.38, 0.46, and 0.70 under the three deployment operators, respectively. In comparison, 8% achieves relatively strong behavioral control while better preserving response quality.
Combining the first-order approximation error analysis and the free-generation experiments, we consider 8% to be a reasonable default deployment strength: it lies within an operating range where the first-order approximation retains good predictive accuracy, and it achieves effective behavioral control in actual generation while better preserving response quality.
Thank you again for your suggestion. We hope that the additional approximation error analysis, intervention strength sweep experiments, and further clarification of the theoretical scope of our method provide a more comprehensive demonstration of the effectiveness and robustness of OCGS in practical deployment.
We sincerely hope that the additional experiments, analyses, and methodological clarifications provided in this rebuttal address your main concerns. If you still have any questions about our work or require further clarification, we would be more than happy to continue the discussion. We also hope that these additional results and clarifications can further strengthen your confidence in our work and lead to a more favorable assessment of the paper. Thank you again for your careful review, recognition, and helpful feedback!
Thanks for the thorough rebuttal. The new CIs for Table 1 and the strength sweep address most of my concerns, and I'm keeping my positive score. One thing remains open: in Table 2 CIs, the matched direction overlaps with the best mismatched one in several rows (e.g Llama and MoE under Decode/All), and the sweep only covers matched directions. A paired comparison of matched vs mismatched would give stronger evidence for the robustness of operator matching. I'll keep rating 3.
Response to Reviewer G6uC (1)
Weakness 1 and Question 1 [ Part 1/2 ]
Thank you for this suggestion. In response to your concerns, during the rebuttal, we further show the main results in Tables 1–2 with confidence interval analyses, clarified how the general capability evaluation results are presented, and incorporated the corresponding results into the revised manuscript resubmitted during the rebuttal. Specifically:
(1) Uncertainty in the main experimental results
First, based on the per-prompt scores from the original held-out evaluation prompts, we supplemented the main experimental results in Tables 1–2 with 95% bootstrap confidence intervals. The point estimates reported in the original manuscript remain unchanged and are still calculated using the original evaluation-set procedure. Specifically, within each behavioral dimension, we perform bootstrap resampling with replacement over the 200 evaluation prompts. The same resampling indices are used for different methods and the Base model to preserve the paired structure. We then aggregate the average gains across the six behavioral dimensions with equal weights, following the same procedure as in the main text, to obtain the final 95% confidence intervals.
① Main-text Table 1: Confidence intervals for the main behavioral-control results.
We supplement the average behavioral gains and their 95% CIs for OCGS, PERSONA, and C-K under the same deployment operators.
Each cell reports Avg. Behavior ΔBase [95% CI], with results averaged equally across the six behavioral dimensions.
As shown in the results, OCGS achieves higher average behavioral gains than both PERSONA and C-K across all three models and all three deployment operators, with its corresponding confidence intervals clearly separated from those of the two baselines. Specifically, the average gain advantage of OCGS over PERSONA ranges from 0.283 to 1.500, while its advantage over C-K ranges from 0.396 to 1.308.
② Main-text Table 2: Confidence intervals for Extraction–Deployment Compatibility.
We also conduct the same statistical analysis on the different extraction–deployment configurations in main-text Table 2, supplementing the average behavioral gains and their corresponding 95% CIs for each configuration.
Each cell reports Mean ΔBase [95% CI]. Bold indicates configurations where the extraction operator matches the deployment operator.
The results show that, across all three models and all three fixed deployment operators, OCGS directions matched to the deployment operators achieve the highest average behavioral gains. These results show a consistent trend favoring operator matching across different models and deployment settings, further supporting the central claim of our work.