- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ConceptTune, a method that bridges gradient-based fine-tuning and activation steering by directly optimizing learnable concept vectors in model activations rather than updating model parameters.
The method introduces concept-targeted generative supervision, where a shared concept vector is optimized across multiple examples by reconstructing expressions of the corresponding concept type.
Experiments demonstrate consistent improvements across three backbone models and favorable performance compared with existing methods, including LoRA and activation steering.
Critical strengths
Novel activation steering approach. The paper proposes a gradient-based approach to learning concept vectors for activation steering, combining the advantages of fine-tuning and activation-level intervention.
Generalizability across backbone models. The proposed method demonstrates consistent performance improvements across three different backbone models, suggesting its applicability to diverse MLLM architectures.
Critical weaknesses
1.Questionable motivation and trade-offs. Although ConceptTune bridges gradient-based fine-tuning and activation steering, it also sacrifices some advantages of both approaches: LoRA introduces no additional inference overhead when merged into the backbone, while conventional activation steering can be training-free. Furthermore, the introduction suggests that LoRA updates are inherently task-specific, overlooking prior work demonstrating the composability of model updates, such as:
Ilharco, Gabriel, et al. “Editing Models with Task Arithmetic.” In The Eleventh International Conference on Learning Representations (ICLR), 2023.
Zhang, Jinghan, et al."Composing parameter-efficient modules with arithmetic operation." Advances in Neural Information Processing Systems 36 (2023): 12589-12610.
The motivation and practical advantages of the proposed method therefore require stronger justification.
2.Questionable LoRA baseline performance. In Table 3, LoRA underperforms the frozen backbone in two of the four settings and provides no improvement in another. These results raise concerns about whether the LoRA baseline is sufficiently optimized, potentially undermining the fairness of the comparison with ConceptTune.
Questions for authors
- LoRA baseline performance. Could the authors explain why LoRA underperforms the frozen backbone in Table 3? Does this suggest overfitting to the task-specific masked-completion training data?
- Semantic specificity of concept vectors. How do the authors verify that the learned concept vectors capture distinct semantic concepts rather than general task-specific biases? In particular, the action vector also substantially improves object-completion likelihood (Figure 3 and Table 8). Could the authors provide additional experiments to validate the semantic specificity of the learned vectors?
3 comments
Response to Author
Thank the author for the rebuttal. I think the rebuttal addresses my concerns. I raised the score accordingly.
Thank you for your careful consideration and constructive feedback throughout the discussion. We are glad that our rebuttal has addressed your concerns. Your suggestions have helped us improve the manuscript, and we appreciate your time and thoughtful evaluation.
Revised Manuscript Uploaded
Thank you again for your constructive suggestions. We have revised the manuscript accordingly and uploaded the updated version, incorporating the additional baseline comparisons and analyses, and clarifying the motivation, practical trade-offs, and concept-related behavior discussed in our responses.