- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper study the personalized image generation, in specific, given the user's interaction history (e.g., chat) and an image generation query, system needs to retrieve relevant history/ preference to enrich the image generation. To that end, the paper introduced a benchmark (100 synthetic users, 168k interactions, 3k image generation requests). Using this benchmark, they evaluate the frontier models (e.g., GPT-Image-2, NanoBanana), and also implemented an improved selection model (VIMGer) to further improve accuracy of BAGEL.
Critical strengths
- I believe the setting where we have users' history/ interaction, and then need to infer user's preference is an emerging topics. I appreciate the efforts of authors' to synthesis the dataset (which include the image generation task) -- This is new as majority of the current benchmark are text-to-text only.
- The experiments include frontier model (e.g., Nano-Banana-2)
Critical weaknesses
While I like the research questions, I think the current submissions can be significantly improved in (i) baseline setting and (ii) agentic workflow.
- First, while the paper is targeting retrieval (and also have RAG as a baseline), none of the memory-layer methods are presented (e.g., Mem0, MemOS). This is critical as for digest chat histories to extract the users' preferences, memory-layers methods are standard.
- Second, the current base model setting is not ideal: Base model is BAGEL, which is significant worse than frontier models (e.g., Nano-Banana-2) in terms of quality, instruction following. I think a better way should be: Implement the baseline where use frontier models as image generation, yet use VIMGer/ RAG/ Memory-layer as history selector (e.g., design an agentic workflow).
While I am not denying the potential usefulness of VMGer, I am saying the current experiment setting/ results do not support the claim that VIMGer is better for extract the users' preference.
Questions for authors
Because the VIMGer scan the history during inference time, what is the cost? (e.g., for each new query, VIMGer will need to scan the history once again?) -- If this is true, then this will be limitation in inference time, as normally interaction history can be 10M+ tokens, not just 12K-token budget.
4 comments
Response to Reviewer DZQH (2/3)
(Part 2/3)
[W2] Why not adopt an agentic framework with frontier image generators and VIMGer, RAG, or memory as the history selector?
We agree that combining stronger image generators with dedicated history-selection modules is a useful practical approach.
-
Existing Frontier-model Evaluation. First, we would like to clarify that our paper has already included evaluations of frontier models, namely GPT-Image-2 and Nano-Banana-2. Importantly, rather than directly feeding the current user query to these generators, we adopt a simple agentic workflow implemented as a history-conditioned, two-stage pipeline. Specifically, an MLLM first reads the user's full interaction history together with the current request, identifies and consolidates relevant historical information, and constructs a personalized, self-contained T2I prompt. This prompt is then passed to the corresponding image generator. We use GPT-5.6-Sol and Gemini-3.8-Flash as the respective MLLMs for this process. Thus, our evaluation already incorporates a simple agentic workflow for personalized generation with frontier image models.
-
History Selector Comparison with Frontier Generators. Furthermore, to directly investigate the reviewer's suggested combination of history selectors and frontier image generators, we conduct a controlled comparison to isolate the contribution of history selection from image generation. Specifically, each frontier pipeline's prompt writer receives sessions selected by RAG, Mem0, MemOS, or VIMGer, while keeping the prompt writer and image generator fixed across selectors. The average VScore-P results are reported below.
Selector GPT-Image-2 TSO GPT-Image-2 PPS Nano-Banana-2 TSO Nano-Banana-2 PPS RAG 42.07 44.93 46.21 49.94 Mem0 43.67 46.42 46.94 50.09 MemOS 43.84 47.14 46.85 50.82 VIMGer 49.57 52.87 53.48 56.86 As shown, VIMGer yields the best results with both frontier generators (e.g., 49.57 vs. 43.84 for MemOS with GPT-Image-2 under TSO). Therefore, VIMGer can also serve as an effective history selector in such agentic frameworks. All comparisons use the same evaluation instances, scoring convention, and judge. These results demonstrate that VIMGer’s learned history-filtering capability generalizes beyond its original UMM backbone and can be effectively transferred to frontier image-generation pipelines.
-
Research Focus and Backbone Choice. Finally, at the methodological level, we specifically investigate whether UMMs can acquire VIMG capabilities through dedicated post-training strategies (also reflected in our paper title). We focus on UMMs because their unified architecture integrates multimodal understanding and generation, providing a natural foundation for learning VIMG within a single model. More importantly, as MLLMs are increasingly adopted as personal assistants in everyday life and image generation becomes a natural part of daily human–assistant interactions, we believe that VIMG should become an increasingly important capability of general-purpose UMMs. We choose BAGEL as a representative open-source UMM backbone because it allows us to directly study and improve the model's intrinsic capabilities through SFT and RL, while providing greater flexibility for research than closed-source proprietary models, and being computationally efficient (only 7B MoT). We fully acknowledge that its general image-generation capabilities are not on par with frontier models.
We fully agree with you that developing more complex agentic workflows for frontier or closed-source models is another valuable direction for addressing VIMG. Indeed, as already discussed in our Future Work, such approaches could leverage external memory, history selection, prompt refinement, and iterative generation without requiring access to model parameters. Given the clear focus of the current work and VIMGer’s role as an initial baseline for trainable UMMs, we leave a more comprehensive exploration of such agentic approaches to future work. We sincerely thank you again for this thoughtful suggestion, which helps us clarify the scope and broader research directions of VIMG.
Response to Reviewer DZQH (3/3)
(Part 3/3)
[W3] Is VIMGer able to extract users' VIMG preferences more effectively?
We thank you for this question. As discussed in our response to the previous concern, the core objective of VIMGer is to enhance UMMs' ability to identify users' personalized visual imagination preferences from long-term interaction histories.
First, our existing experiments demonstrate substantial improvements over the original BAGEL backbone under controlled settings. Specifically, VIMGer improves the average VScore-P across six domains from 14.29 to 38.14 under TSO (+166.9%), and from 19.15 to 39.19 under PPS (+104.7%). Moreover, VIMGer also outperforms the Mem0 and MemOS baselines in Part 1. Overall, these results demonstrate VIMGer’s effectiveness in enhancing UMMs' end-to-end VIMG capabilities.
Furthermore, to investigate whether these improvements generalize beyond BAGEL, we conduct additional experiments using SenseNova-U1 as another UMM backbone. Notably, the original SenseNova-U1 already consistently outperforms BAGEL Base across all six domains under both settings, indicating its stronger initial VIMG performance. With VIMGer, its average VScore-P further improves from 19.72 to 41.21 under TSO and from 27.61 to 44.21 under PPS, which shows that our post-training approach transfers beyond BAGEL.
| Method | TSO | PPS |
|---|---|---|
| SenseNova-U1 | 19.72 | 27.61 |
| + VIMGer | 41.21 | 44.21 |
[Q1] Discussion of overhead of VIMGer.
We thank you for raising this question. First, we clarify that the 12K-token budget mentioned in our paper refers to the maximum size of each history window, rather than the total history length. Our current implementation already supports arbitrarily long interaction histories by partitioning them into contiguous windows of at most 12K tokens, filtering each window independently, and merging the retained relevant sessions. As a rough estimate, filtering a 168K-token history takes about 28 s, with 14 serial 12K-token windows at about 2 s each.
Regarding computational cost, we believe that the overhead of scanning the history is a reasonable trade-off for VIMG. Specifically, as discussed in our previous responses, current image-generation queries are often short and highly contextualized, making direct query-based retrieval (e.g., conventional RAG) unreliable for identifying VIMG-related preference evidence scattered across seemingly unrelated historical interactions. This is reflected in the lower scores of the RAG and memory baselines compared with VIMGer. Achieving more reliable retrieval would require additional reasoning over the user's history to contextualize or expand the query, which itself incurs computational overhead. Our design therefore prioritizes directly accessing the original history to improve preference-evidence coverage. Moreover, VIMGer completes filtering, imagination, and rendering within a single 7B open-source UMM, whereas the frontier pipelines rely on a proprietary MLLM and a separate image generator, which keeps its deployment cost low.
Nevertheless, several engineering techniques could further reduce inference latency. For example, modern UMMs and LLMs support efficient, parallelized prefill for long inputs. Moreover, since user histories remain largely unchanged across successive queries, KV caching could allow previously processed history windows to be reused, avoiding redundant encoding and computation. We believe these optimizations offer promising opportunities to improve VIMGer's efficiency while retaining the benefits of directly scanning long interaction histories.
We sincerely thank you for your recognition of our work and for the time and effort you have devoted to reviewing our paper. We hope that our responses and additional empirical analyses have addressed your remaining concerns. We would be more than happy to continue the discussion and address any further questions you may have.
As the discussion period draws to a close, we would be grateful to hear whether our responses have addressed your concerns. We would also be happy to continue the discussion.
Response to Reviewer DZQH (1/3)
We sincerely thank you for the thoughtful reading and for appreciating the novelty of VIMG and our extension of personalization evaluation to image generation. We address your concerns below.
We sincerely thank you for this valuable suggestion. We agree that memory-based methods are an important approach to leveraging long-term user interaction histories. In our initial design, we focused primarily on establishing VIMG as a new task and benchmark, and thus adopted relatively simple baselines (History and RAG) rather than exhaustively exploring different memory architectures.
Following your suggestion, we have added Mem0 and MemOS as additional baseline, using BAGEL as the common generation backbone and evaluating them under TSO and PPS settings. The results are reported in the table below, showing relatively limited performance.
We believe their limitations on VIMG can be understood from two aspects. First, pre-constructed memory may introduce information loss (e.g., SeCom). In particular, memory compression is performed before the current image-generation query is known, making it impossible to preserve information selectively according to its future relevance. This inevitably risks discarding fine-grained visual preference cues that may become crucial for VIMG. Second, query-only-conditioned retrieval may fail to identify the evidences for personalized image painting requests. Both methods retrieve from pre-constructed memory based on the current request. However, VIMG queries are often short and semantically underspecified (e.g., "Draw a soldier"), while relevant visual preferences may have been revealed in seemingly unrelated historical interactions. Consequently, retrieving memories based solely on the current request may fail to recall such evidence. This also motivates our design of VIMGer, which directly accesses the original interaction history through window-wise filtering, identifying query-relevant preference evidence before performing personalized visual imagination.
Nevertheless, we believe memory-based approaches remain a promising direction, as also discussed in our future work. We have incorporated the new baselines and corresponding discussion into the revised manuscript. Thank you again for helping us improve the paper.