- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes AIMES, a framework for adaptive multi-value activation steering in LLMs. The method constructs layer-specific bipolar directions for Moral Foundations Theory values, uses intermediate-layer vocabulary readouts, primarily J-Lens, as online value-state observers, and adjusts value-specific steering strengths at each decoding step. Experiments across five models show that the effectiveness of multi-value steering depends strongly on intervention depth and value combination, and AIMES can outperform fixed multi-value steering and prompt steering in several settings, particularly for the competing objective of increasing Care and Fairness while suppressing Sanctity.
Critical strengths
The paper addresses an interesting problem that is less explored than single-attribute activation steering: adaptive joint control of multiple interacting human values. The use of J-Lens as a training-free online observer is a sensible and potentially useful design choice, and the paper evaluates multiple model families, intervention depths, and two independent judges. I also appreciate that the authors do not overstate universality and explicitly report substantial model-, depth-, and evaluator-dependence.
Critical weaknesses
-
The central observer assumption is insufficiently validated. AIMES treats the average J-Lens readout over a small manually defined token set as the model’s current value state. However, higher accessibility of value-related words in vocabulary space does not necessarily imply stronger behavioral expression of the corresponding value. Since this observer directly drives the controller, stronger validation of its construct validity is needed.
-
The contribution of adaptivity itself is not well isolated. The controller uses a very simple state-dependent scaling rule, but the paper does not compare it against alternative adaptive controllers, threshold-based gating, other monotonic mappings, or perturbation-matched controls. It is therefore unclear whether the gains come from the observer, token-level adaptation, reduced intervention magnitude, or the particular controller design.
-
The baseline set does not sufficiently cover the closest adaptive or feedback-based steering methods. The main comparisons are against fixed multi-value steering and prompt steering. Given the existence of prior adaptive and feedback-controlled activation steering methods, direct experimental comparison with these approaches is important for establishing the incremental contribution of AIMES.
Questions for authors
- How well do the J-Lens observer scores correlate with independently measured behavioral value expression?
- How sensitive are the results to the manually selected value-token sets?
- Does AIMES still outperform fixed steering when the two methods are matched by realized perturbation magnitude?
- Why are existing adaptive or feedback-based activation steering methods not included as direct baselines?
2 comments
Dear Reviewer eSs3, As we approach the end of the discussion period, we would like to sincerely thank you again for your constructive feedback and thoughtful evaluation. We believe we have addressed most of your concerns through our detailed responses, additional experiments, and revised manuscript. We would be very grateful if you could take one final look at these updates and consider revisiting your assessment and score in light of the new evidence. If you have any other question we would be happy to clarify. Thank you again for your time and consideration.
Gentile reminder to reviewer eSs3
Dear Reviewer eSs3,
Thank you again for your constructive feedback. We have addressed your comments in our responses and uploaded a revised manuscript incorporating additional experiments, including J-Lens observer validation and comparisons with Mean-Strength Fixed Steering. We would be grateful if you could review our responses and the updated manuscript and reconsider your assessments and scores in light of the new evidence.
Thank you for your time and consideration.