- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper treats activation steering as a calibration problem. The authors extract eleven steering vectors from contrastive system prompts, one per behavior (complexity, formality, politeness, refusal, and so on). Each is injected at a single chosen layer. Each coefficient is normalized by the largest magnitude that keeps judged coherence close to the unsteered model, so the steering space becomes . The coefficients get a Gaussian prior, . The mean judge score of each behavior over a fixed prompt set is then approximated by a second-order Hermite polynomial expansion in , fit by weighted ridge regression on about 200 sampled configurations.
With this surrogate, the user states target scores and tolerances, and a penalized least-squares objective is minimized to find the coefficients. A feasibility test borrowed from the combustion-kinetics literature flags targets that cannot be met. It removes them one at a time using a sensitivity-weighted residual. A Laplace-style covariance around the solution describes which coefficient directions are pinned down by the request and which are left free. It can also be propagated to behaviors that were not targeted.
Critical strengths
The main idea is a cross-domain transfer. Solution mapping, polynomial chaos expansions, and the feasibility test come from uncertainty quantification in chemical kinetics. I have not seen them applied to activation steering, and the fit is natural. Steering papers usually report parameter sweeps. This paper instead builds an explicit forward model and inverts it.
Critical weaknesses
The central claim is that the response surface plus optimization gives better steering than sampling. But the paper’s own “grid selection” baseline undercuts this. Grid selection uses the same calibration data and simply picks the measured configuration closest to the target. On HelpSteer2 (Table 5), grid selection or grid plus prompting is best in most cells. On Code-UltraFeedback (Table 1), grid plus prompting beats the method on Phi-4-mini [3,3,3,3,3] (57.1 vs 52.8 success rate) and is close elsewhere. If a nearest-neighbor lookup over the 249 measured points does as well, then the extra value of the polynomial surrogate for target-reaching is unclear. The paper should state this result directly and explain where the surrogate is actually needed. Plausible answers are feasibility diagnosis, the covariance, or targets far from any sampled point, but these are not tested head to head.
Questions for authors
Can the authors explain why grid selection performs as well as or better than the full method on most benchmark cells? In which concrete situations does the surrogate give an advantage over a nearest-neighbor lookup on the same calibration data? If possible, a small analysis restricted to targets far from all sampled configurations would be very informative.
2 comments
Follow-up to Reviewer rtoo
Dear Reviewer rtoo,
As the discussion period comes to a close today, we wanted to briefly follow up on our response above. We have provided further clarification on where the surrogate is needed beyond grid selection, including a new head-to-head analysis on specifications that no measured configuration satisfies (Appendix G.1). The revised PDF has also been uploaded.
We hope this additional analysis helps answer your question, and we would be happy to address any remaining questions or comments. Thank you again for your thoughtful review.
Response to Reviewer rtoo
Thank you for your detailed review. We appreciate your feedback and would like to address the weaknesses and questions you raised.
Weakness 1: why grid selection is competitive on the benchmark.
Grid search is effective on this benchmark because the benchmark (as defined by Zhang et al.) predominantly requires configurations that exist in the calibration data. The defined targets are close to typical scores, and the success of grid search simply reflects the fact that there is often a calibration configuration that directly satisfies the provided targets. Thus, this comparison does not consider situations involving targets that no calibration configuration is close to, where our method is most advantageous. Nonetheless, we include this comparison because there are very limited precise steering benchmarks in the literature. We believe it is important to validate our approach and demonstrate it performs competitively in comparison to existing methods and simple alternatives.
Weakness 1 and questions: where the surrogate is needed, tested head to head.
The surrogate is needed where no measured configuration satisfies the user request. This becomes typical as more targets are specified at once. Among random specifications accepted on Qwen3-8B:
Following your suggestion, we ran the analysis restricted to targets far from all sampled configurations. We took specifications with four or five targets that no measured configuration satisfies, 45 targets in all, and generated and judged both our solution and the nearest measured configuration (grid selection) on the 132 held-out prompts (new Appendix G.1). We summarize our findings here:
Our surrogate reaches significantly more targets at approximately the same intervention magnitude (median norm 0.96 against 1.00) and coherence score (7.2 against 7.5). The surrogate also misses targets by a substantially smaller margin. Where the acceptable range exceeds the forecast error, the median miss is 0.39 points against 0.57, close to the held-out forecast error of the surfaces (0.37). Beyond this head-to-head test, we also checked target attainment on a larger set of random specifications. On 100 random specifications of one to four targets, measured scores at our solutions miss their targets by a median of 0.34 points, and 232 of 249 targets are within one point (Appendix H.4). As you mention, the surrogates also enable consistency diagnostics and covariance analysis. We validate the consistency diagnostic against 2,192 refused specifications, none of which is satisfied by any measured coherent configuration (Appendix H.4). Further, in Section 5.5, we use the covariance to show that, in the case study, helpfulness can vary 1.5 points while satisfying the original user request. This readily enables consideration of secondary objectives.
Changes. A new paragraph in Section 5.6 states directly that grid selection is competitive on the benchmark, why grid selection is competitive, and where the surrogate is needed. New Appendix G.1 gives the full analysis, including how often no measured configuration satisfies a random specification and the head-to-head test described above. Grid selection also appears in Table 12 on the 12 random specifications, meeting 17 of 30 targets against 19 for our approach.