- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper systematically studies the cross-modal transfer ability of Steering Vectors in unified multimodal generation models. Through bidirectional causal interventions on three models, namely UniAR, Emu3.5, and Liquid, the authors find that concept directions extracted from text or images can achieve zero-shot control in the other modality. They further analyze the connection between this transfer ability and the geometric relations of cross-modal representations.
Critical strengths
-
The experimental details are clearly described.
-
The experiments are fairly comprehensive, and the unique geometric analysis has certain value.
Critical weaknesses
-
The novelty of the paper is very limited. Can a vector learned in one model be applied to other models? If the finding only holds within the unified own models, it has little meaning. The original purpose of unified models is to provide a unified representation of different modalities, such as images and text, inside the model. Therefore, it is expected that vectors extracted from different modalities have similar or the same effects. This is a natural consequence of the design.
-
I do not see the motivation of the paper from beginning to end. The existence of such cross-modal steering vectors inside a unified model is not very surprising. Then what is the use of such vectors? Or what is the use of this finding for the development of multimodal models? The specific pattern found in unified models cannot be extended to other multimodal models.
Questions for authors
-
The paper extracts vectors by taking the mean of activation differences. This is a very coarse and inaccurate approach. I doubt the ability of such extracted vectors, especially abstract vectors, to transfer to other modalities and concepts.
-
As the authors state in line 92, existing work has already studied cross-modal steering in unified models and reached conclusions different from this paper. Why is that?
-
The authors state that "In Emu3.5 and Liquid, text-derived vectors sometimes even steer images better than image-derived ones". Why is this? It is puzzling.
-
The paper contains statements such as "steering an image generator with a vector for formal vs. colloquial language causes people or rooms to be depicted more formally, and steering a language model with a vector for low image resolution causes the model to write shorter text and express uncertainty". I do not know how to understand the boundaries of abstract concepts such as formal and informal as defined in the paper. Moreover, the logic of the presentation is not fluent.
-
Section 2.1 spends a large amount of space introducing very basic content, which should be summarized in the related work. The method section contains no novel content and is basically a description of simple and generic approaches.
-
The evaluation system has flaws, and the testing and assessment contain same-family circular dependencies. The minimal pairs, image edits, and evaluation prompts are all generated by Gemini-family models, and the judge is also Gemini 3.7 Flash. The "concepts" being evaluated are partly defined by the editing behavior of Gemini. A judge from the same family may inherit the concept bias of the data generation model, thus systematically overestimating the success rate of cross-modal transfer. Although human annotation is used to validate the automatic evaluation, experiments with a single same-family model are not sufficient.
-
The evaluation content is incomplete. The paper mainly checks whether the target attribute changes, but it does not clearly evaluate other core application metrics, such as unintended changes to other attributes or degradation of instruction-following ability.
4 comments
Addressing detailed questions
Thank you for the reading our paper thoroughly and raising some important questions!
Other methodological Qs
Q1: Mean of activation differences methodology as “coarse and inaccurate” approach: This is the most standard steering approach, to our understanding. It is highly established in LLMs and, in recent years, also more in vision. We extensively cite and contextualize this in Section 2.1. Mean of activation differences is also a very natural solution for achieving one unified and comparable steering framework for both modalities. In fact, simplicity of steering design can be seen as a strength: Complex steering approaches can often be heavily parametrized for little-to-no performance gain, and, critically, are less faithful to the underlying representations, similar to complex probes.
Re “I doubt the ability of such extracted vectors”: Our experiments establish at least a lower bound on this ability, i.e., we measure concept presence in generated outputs.
Q2: Why Wang & Li (2026) [5] reached different conclusions is a great question. We briefly discuss the main differences in our related work section: We suspect it is because they primarily rely on BAGEL, which is not very unified; e.g., BAGEL has separate weights for text and and image generation, which interact only through attention. Their code is not public.
Q3: Why do text-derived steering vectors sometimes work better than image-derived for images? Intuitively, image generation has been “steered” by text via prompting for many years, and text may provide a less noisy semantic space [6]. We will revise the paper with this explanation.
Q4: Regarding the boundaries and logic of abstract concepts like “formal vs. informal”: Our motivation is that cross-modal steering would be most interesting to study when the concept is not equally represented in vision and language data. This might constitute even stronger evidence of cross-modal transfer. We agree there is some subjectivity in how formal vs. colloquial language vectors would manifest visually, but we do think some abstract notion of “formality” can be visual, such as clothing or interior design.
Q5: Is Sec. 2.1 needed: We did not want to assume deep familiarity with either UMMs or steering vectors, especially since some readers might only know steering vectors for LLMs and other readers for image generation.
Q6: “Circular dependencies” using Gemini: We re-judged half of the prompts in the main evaluation (9,600 pairs) with a different judge (Claude Opus 5.5, no few-shot examples). It is stricter in absolute terms but picks the opposite candidate on only 1.1% of pairs. Recovery with Claude vs. Gemini (UniAR / Emu3.5 / Liquid):
- text→image: 0.82 / 1.38 / 1.32 vs. 0.89 / 1.27 / 1.25
- image→text: 0.74 / 0.45 / 0.41 vs. 0.76 / 0.61 / 0.45
We would like to emphasize that the typical circular dependency is not an issue here: The models producing the steered outputs and the judge are fully separate. When you refer to “image edits”, these are not steered outputs but the minimal pairs that are ultimately collapsed into a single vector. We also note that our randomly shuffled evaluation protocol controls for judge bias towards the steered or unsteered sample.
Q7: Other attributes and instruction following beyond concept presence: App. A.7 shows output quality against steering strength (text fluency, image coherence). Instruction following for text stays at 90% or more of its unsteered level up to the alpha strength where concept effect peaks. We are not claiming to release a proper editing tool and mainly emphasize the interesting phenomenon of cross-modal steering.
We are happy to answer any further questions. If your primary concerns are addressed, we hope you consider reflecting this in your final rating
[5] Wang, Yu, and Sharon Li. "Do Unified Multimodal Models Think in One Space? A Lens Through Cross-Branch Steering." arXiv preprint arXiv:2607.26411 (2026). [6] Ekin, Yigit, and Yossi Gandelsman. "The unreasonable effectiveness of text embedding interpolation for continuous image steering." arXiv preprint arXiv:2603.17998 (2026).
Dear Reviewer,
Thank you again for your time and effort on this. Since we have uploaded a revised version of the paper yesterday, let us know if this adequately addresses your primary concerns. See the global response for some details what we changed and the PDF itself for the actual changes.
Dear Reviewer Bu22,
We hope you engage with our response, especially the first of the two messages: We genuinely believe these findings are far from expected and we encourage you to consider the work we cite to support this. Also for people who don't work on UMMs, and for example just on steering vectors and their robustness, these findings are interesting.
Addressing main concerns
Dear Reviewer Bu22,
Thank you for engaging with our paper in detail. We will primarily discuss your main critiques around novelty and surprise, and address the other points at the end.
W1: Novelty and surprise
We think cross-modal steering vectors are quite surprising and far from obvious. In fact, we argue that such alignment might be less obvious in UMMs than in LLaVA-style VLMs.
We also think our finding is non-trivial when considering the steering literature. Even when studying steering vectors in the context of text generation, generalization to different prompts and task settings is an active research area [3, 4, inter alia].
We are not aware of work showing that cross-modal steering is trivial, and will be happy to directly respond to any pointers the reviewer provides. This seems to us like the primary concern we’d like to understand further. It might ultimately also improve our framing and writing of the final version.
W2: Why study UMMs
So, why work on UMMs if they are far from solved? As you point out: “If the finding only holds within the unified own models, it has little meaning.”
UMMs are in another sense the most general form of current AIs, and follow the philosophy of our field in recent years: one model that can process and generate any form of data. We therefore expect them to grow stronger and more mainstream with time, and for phenomena like cross-modal steering vectors to improve. So it is worth understanding UMMs scientifically already now.
[1] Serra, Alessandro, et al. "The narrow gate: Localized image-text communication in native multimodal models." Advances in Neural Information Processing Systems 38 (2026): 74684-74712. [2] Gao, Xin, et al. "Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs." arXiv preprint arXiv:2606.00477 (2026). [3] Da Silva, Patrick Queiroz, et al. "Steering off course: Reliability challenges in steering language models." Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025. [4] Tan, D., et al. (2024). Analysing the Generalisation and Reliability of Steering Vectors. NeurIPS 2024. https://arxiv.org/abs/2407.12404.