- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors present JAM, an activation steering method that formulates activation steering as an optimization problem with constraints. Given a binary logistic classifier on the activations that project them to the score space , JAM introduces the minimum-norm intervention that would result in a "non-toxic" classification. This intervention is the one that transports the current activation orthogonally to the classification hyperplane if classified toxic, and abstains if already classified non-toxic. The authors find that JAM works well in practice and does not significantly impact text fluency.
Critical strengths
N/A; highly redundant with already published work, see Weaknesses.
Critical weaknesses
The presented approach is identical to LiSeCo (https://openreview.net/forum?id=a3o2pzZuvE), an already published controlled generation method in the literature (which has been on Arxiv since 2024, and published June 2026); see Theorem 1 in their paper. Indeed, LiSeCo is even more general than the presented method, permitting controlling activations to level sets that correspond to a given classifier score (in contrast to solely the boundary margin presented in this work). Unfortunately, it is difficult to see how this paper advances beyond LiSeCo and its follow-ups (e.g., MERA, https://openreview.net/forum?id=fUCPq5RvmH).
Questions for authors
None