- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SEER, a framework designed to bridge the cognitive gap between understanding and generation in Unified Multimodal Models (UMMs). The proposed approach introduces Endogenous Reprompting, which enables a unified model to translate user instructions into generation-oriented prompts aligned with its own generative capabilities. SEER consists of two stages: (1) Reinforcement Learning with Verifiable Rewards (RLVR), which trains an internal evaluator through curriculum learning and pairwise visual comparisons, and (2) Reinforcement Learning with Model-rewarded Thinking (RLMT), which optimizes the reprompting policy using feedback from the internal evaluator.
Critical strengths
The paper addresses an important challenge in unified multimodal models: effectively transferring visual understanding capabilities to image generation.
Critical weaknesses
-
A central claim of the paper is that using the internal comprehension capability of UMMs to generate the reprompt can better match the image generator's generative priors than an external LLM. The author uses Table 2 to demonstrate that SEER outperforms external reprompters such as GPT-5.2, Gemini3, and PromptEnhancer. However, this experiment only shows that SEER's reprompting effect is better, and cannot fully prove that the advantage comes from the consistency of the model's internal representations because Seer has also introduced other training mechanisms. A suggestion is training the respective Reprompter for each of the two models, then exchange generators for testing. Only when the model significantly outperforms the cross-combination during matching can it better support Model-Specific Alignment.
-
The internal evaluator carries the risk of reward hacking and self-reinforcement bias. Reprompter learns to generate visual features preferred by the Evaluator, but these features do not necessarily align with human preferences. Additionally, the Evaluator and Reprompter share correlated errors, causing the training process to continuously amplify these errors.
Questions for authors
- Could the authors provide more evidence to support the claim that using the internal comprehension capability of UMMs to generate the reprompt can better match the image generator's generative priors than an external LLM?
- Could the authors provide additional evidence of generalization on larger, independent benchmarks with more diverse and compositional visual instructions?
3 comments
Thanks for your rebuttal. I maintain my score.
Thank you for your time and thoughtful review. We sincerely appreciate your positive assessment and consideration of our work.
Thank you for recognizing the importance of transferring visual understanding to image generation and for suggesting the cross-model reprompter exchange. We hope our response will resolve your concerns.
W1 & Q1 — Cross-model reprompter exchange.
Following your suggestion, we trained reprompters for Harmon-1.5B and Show-o2-1.5B with the same 300 examples and SEER procedure, using feedback from their respective UMMs, then swapped their reprompts across fixed generators.
Both generators perform better with their matched reprompters on CLIP and ImageReward. This supports model-specific alignment.
W2 — Reward hacking and correlated errors.
We checked evaluator decisions against independent human judgments using eight image pairs sampled every 10 RLMT steps, obtaining 90.4% agreement. Blind human evaluation also favors SEER over the Harmon base (0.85, Table 3). These results provide independent evidence that the learned improvements align with human preferences rather than only the internal evaluator's judgments.
Q2 — Independent WISE evaluation.
We evaluate generation with and without SEER reprompting on WISE (Niu et al., ICML 2026), with 1,000 prompts covering 25 subdomains. Both settings use the same trained model and generation settings.
The largest improvements are in cultural commonsense and spatial/temporal reasoning. Biology is nearly unchanged. WiScore was evaluated using a Qwen-based judge.