- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes KANSteer, a nonlinear activation steering method for text-to-image diffusion models. By modeling concept transitions as one-dimensional curved trajectories rather than fixed linear directions, the method enables smoother traversal of intermediate visual attributes. The experimental results demonstrate consistent improvements over linear steering across several concepts and model configurations.
Critical strengths
The paper is clearly motivated and well presented. The idea of modeling nonlinear concept trajectories is interesting, and the qualitative and quantitative results are encouraging.
Critical weaknesses
My primary concern is the relationship to Wurgaft et al. (2026), Manifold Steering Reveals the Shared Geometry of Neural Network Representation and Behavior. Both works explore nonlinear concept geometry and steering along curved trajectories in activation space.
Although this paper introduces a KAN-based parameterization and focuses on text-to-image models, I would encourage the authors to further clarify the conceptual and methodological distinctions from this closely related work. In particular, it would be helpful to discuss what additional insights or capabilities the proposed formulation provides beyond existing manifold steering approaches.
Questions for authors
Necessity of KANs. Could the authors compare KANSteer with simpler nonlinear trajectory parameterizations, such as cubic splines or small MLPs? This would help clarify whether the improvements come from the KAN architecture or nonlinear steering more generally.
Geometry of concept representations. The method assumes that ordered visual attributes can be described by a one-dimensional trajectory. How well does this assumption generalize to more complex concepts involving multiple interacting attributes?
Thank you for the updated manuscript. I've taken a look at the revision.
W1 is addressed, and you present strong results. You include new ablations over MLP, evidence of superior generalization, and reasonable argument for KANSteer over an MLP. My concern here is addressed.
W2/Q3.1 is also resolved. This is sufficient evidence to me to suggest it is not overparameterized. The random-network negative control is not included, but you show a practical benefit here and constrain the possibility of overfitting.
Q2 is directly addressed with the SANA experiments, comprehensively analyzing the baseline comparisons, extrapolation, and component ablations.
Q3.2 is also addressed. The grid search detail is included in the appendix.
W3 is mostly addressed. You present good evidence that the system effectively steers generated attributes, and that it captures regularities in the activation geometry. The interpretation of this as a mechanistic understanding or a simply useful nonlinear coordinate system is still open, but the claims have been narrowed to address this.
I am updating my review to a weak acceptance. Thank you for the great read!