- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes TRIS, an activation-steering method that adjusts gradient updates using regularized activation variances. It formulates the update as steepest ascent under a Mahalanobis metric to calibrate intervention strength across directions and activations. Across four LLMs on truthfulness, helpfulness, and detoxification, TRIS outperforms ODESteer in 10 of 12 model–task comparisons. The experiments also examine sensitivity to steering strength, reuse of covariance estimates across tasks, and computational overhead.
Critical strengths
-
The method is easy to understand and reasonably motivated. It adjusts steering updates to account for different activation scales, has a clear mathematical interpretation, and adds little computational cost.
-
The comparison with ODESteer is controlled in some respects. Both methods use the same objective, fitting data, and integration steps. TRIS performs better in 10 of 12 model–task comparisons, providing some evidence that the change is useful.
Critical weaknesses
-
Parameter selection and robustness to steering strength are not fully clarified. The paper reports the best scores over 50 values of and selects the shared using the evaluation scores, without describing a separate validation set. Moreover, has different units in TRIS and ODESteer, so using the same numerical range does not establish that TRIS is inherently easier to tune.
-
The experiments do not isolate the benefit of covariance calibration. TRIS makes a relatively small change to ODESteer, modifying both the update direction and its magnitude without separating their effects. The diagonal estimator ignores correlations, so it need not remove the anisotropy shown in Figure 1. The theory establishes steepest ascent under the chosen metric, but does not show that this metric better captures the behavioral effects of steering. Covariance is also estimated at the last input token and applied throughout generation, without checking whether those statistics remain suitable for generated tokens.
-
The detoxification gains come with higher perplexity. TRIS has higher perplexity than ODESteer on all four models, sometimes near the allowed limit of 30. The results therefore do not establish a better toxicity–quality trade-off at comparable perplexity.
Questions for authors
-
Were and the intervention layer selected independently of the final evaluation data? Do the gains and robustness results hold with validation-based selection and steering ranges adjusted for the methods’ different scales?
-
Can you separate the effects of changing direction and magnitude using a baseline that keeps the original gradient direction but normalizes its length under the same Mahalanobis metric? Could strong shrinkage partly explain the similarity of covariance estimates across tasks?
-
Does TRIS achieve lower toxicity at comparable perplexity? Can you provide toxicity–perplexity curves across steering strengths?