- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses compositional text-to-image generation under long prompts. Its goal is to let the understanding capability of a unified understanding–generation model (BAGEL) provide semantic feedback at intermediate generation states, and to use that feedback to train the generator. On five benchmarks, the method achieves higher overall scores than BAGEL and four reward-optimization baselines.
Critical strengths
- The problem is valuable. Using semantic judgments on intermediate generation states to guide generator training is a natural and important direction for post-training unified models. Figure 1 intuitively shows that the spatial relation is already largely determined early in denoising.
- The experimental coverage is broad. The method achieves the best overall score on all five benchmarks. The paper also provides fine-grained analyses, including joint satisfaction rates and per-question repair/regression statistics.
- The paper is well structured, and the method overview figure is clear and easy to follow.
Critical weaknesses
- The source of the gains is unclear. Before latent optimization, the generator has already been aligned with the image-level reward, but the performance of this image-aligned starting checkpoint is not reported. As a result, the contribution of image-level alignment cannot be separated from that of latent feedback. In addition, Section 4.1 states that UR and LR start from the same image-aligned initialization, yet the base score in Table 6 (67.50) matches that of the original BAGEL. The starting point of each experiment should be clarified. I suggest adding stage-wise ablations that show the actual contribution of each component beyond the latent reward.
- Comparisons with closely related work are missing. The paper cites several latent-level reward methods but does not compare against them experimentally. Moreover, some baselines (HPSv3, PickScore) mainly target aesthetics or human preference rather than instruction following, which makes them relatively weak points of comparison.
- The annotation judges and the evaluation VLMs are not clearly specified.
- Qualitative results are limited. The qualitative comparison consists of only three examples in Figure 3, without the UR variant or any failure cases. This makes it hard to see what latent feedback adds over image-level rewards.
Questions for authors
- The reader is trained on t ∈ [0.3, 0.9], but during generator optimization it must score child states at roughly t ≈ 0.92–0.975. Is the reader's judgment reliable in this extrapolated range?
- Can the method be transferred to other generation tasks, such as image editing?
- What exactly does "Trust" in the title refer to? It does not seem to be defined anywhere in the paper.
8 comments
Response to [W2]
Response to [W2]: Comparisons with Closely Related Work
We thank the reviewer for the suggestion. We first explain the rationale behind our existing baselines, and then report direct comparisons with more task-specific image-level rewards and related latent-level rewards.
1. Rationale for the original baselines
- General preference rewards (HPSv3, PickScore). These are the most widely used rewards in RL for text-to-image generation. Although trained on human preference data, both condition on the text prompt and thus account for prompt–image matching.
- Semantic alignment rewards (UnifiedReward-2.0, VQAScore). These directly target text–image semantic alignment.
The original comparisons thus already cover both types of text–image reward signals.
2. Additional baselines
- Image-level rewards. FGA-BLIP2 (AAAI 2026) focuses on fine-grained text–image semantic matching; LLaVA-Reward (ICCV 2025) uses a multimodal LLM to evaluate images along multiple dimensions, including text–image alignment.
- Latent-level rewards. StitchVM (NeurIPS 2026) connects intermediate generator features to a pretrained reward model to learn value estimation on noisy states; LPO (NeurIPS 2025) uses the diffusion model itself as a noise-aware latent reward model. Since both were designed for diffusion models, we adapt them to BAGEL's intermediate generation features.
Table R2. Comparison with additional image-level and latent-level reward methods (% ↑).
| Method | DetailMaster | TIIF | LongT2I | UniGen++ | DPG |
|---|---|---|---|---|---|
| FGA-BLIP2 | 55.70 | 72.59 | 80.83 | 81.22 | 86.29 |
| LLaVA-Reward | 57.02 | 74.65 | 81.31 | 82.70 | 85.86 |
| StitchVM (Latent) | 55.54 | 71.87 | 79.50 | 82.07 | 84.66 |
| LPO (Latent) | 53.08 | 68.13 | 78.52 | 80.49 | 83.21 |
| UR | 58.78 | 76.75 | 82.66 | 85.97 | 87.70 |
| LR (Ours) | 59.95 | 79.49 | 83.95 | 88.60 | 89.18 |
Trust-to-Latent achieves the best results on all five benchmarks, and even the strongest new image-level reward, LLaVA-Reward, remains clearly behind. The two latent-level methods fail to bring consistent improvements: StitchVM stays roughly on par with BAGEL, and LPO, which learns preferences from generation features without an understanding prior, even falls below it, as both struggle to judge compositional constraints such as attributes and spatial relations. In contrast, our method brings semantically supervised understanding into the evaluation of intermediate states, suggesting that reusing understanding capability is key to effective latent feedback.
Response to [W3] & [W4]
Response to [W3] & [W4]: Annotation Judges, Evaluators, and Qualitative Results
We thank the reviewer for these suggestions, which we address below.
1. [W3] Annotation judges and evaluation models
- Training annotation judges. We use three multimodal models from different families to construct the image-level reward training data: Gemini 3.1 Pro (Google), Kimi K2.6 (Moonshot AI), and GLM-4.6V (Z.ai).
- Benchmark evaluation models. Each benchmark follows its officially released evaluation pipeline, and all methods on the same benchmark share a fixed evaluation configuration (Table R3).
Table R3. Benchmark evaluation models and checkpoints.
| Benchmark | Evaluation Model / Pipeline | Model Family / Backbone |
|---|---|---|
| TIIF-Bench | Qwen2.5-VL-72B-Instruct | Qwen2.5-VL |
| DetailMaster | Qwen2.5-VL-7B-Instruct + YOLOE-11L + BLIP-ITM | Qwen2.5-VL / YOLOE / BLIP |
| LongT2IBench | LongT2IExpert | Qwen2.5-VL-7B-Instruct |
| UniGenBench++ | UniGenBench-EvalModel-qwen-72b-v1 | Qwen2.5-VL-72B |
| DPG-Bench | mPLUG VQA (damo/mplug_visual-question-answering_coco_large_en) | mPLUG |
- Model independence. The annotation judges belong to different model families from the test-time evaluators and share no weights or checkpoints with them; they are never invoked at test time.
2. [W4] Qualitative results
We have added a qualitative comparison to the revised manuscript; please see Figure A2 in Appendix L (page 21 of the revised PDF, appendix page 9). It includes BAGEL, UR, and LR with shared prompts and random seeds, as well as a failure case. The differences between UR and LR mainly arise in structural constraints determined early in generation:
- (a) Object state. The teapot lid should be removed and placed in front; BAGEL and UR keep the lid on and add an extra one, while LR generates an open teapot.
- (b) Spatial layout. UR violates "bird at the rear left, bowl at the front right"; LR follows it.
- (c) Hierarchical structure. For a two-tier stand, UR generates three tiers with misplaced strawberries; LR keeps two tiers with macarons on top and strawberries below.
- (d) Exact counting. For "exactly one" tulip, BAGEL and UR generate two; only LR is correct.
Such constraints are largely fixed early in denoising (Figure 1). Image-level rewards only score the completed image and can hardly attribute feedback to these early decisions, whereas LR judges intermediate states directly and corrects such errors more effectively.
Failure case (e). The prompt requires exactly two strawberries under soft, diffused daylight. BAGEL and UR generate three strawberries; LR satisfies the count but shows noticeable direct sunlight. When content and global style constraints co-occur, LR corrects object-level errors but does not fully follow the lighting style.
Response to [W1]
Response to [W1]: Source of the Gains and Initialization
We thank the reviewer for this helpful comment. We first clarify the starting point of each experiment, and then report a stage-wise comparison.
1. Training pipeline and starting points
2. Stage-wise comparison
We evaluate BAGEL-Post-U on all five benchmarks. UR and LR both start from it with matched budgets and inference settings, differing only in whether feedback comes from completed images (UR) or intermediate states (LR).
Table R1. Stage-wise generation performance across five benchmarks (% ↑).
Δ is reported in percentage points.
The shared initialization is on par with or slightly below BAGEL, so the gains do not come from a stronger starting point. Both methods clearly improve over it, and LR outperforms UR on all five benchmarks; since everything else is matched, this additional gain is attributable to latent-level semantic feedback.
3. Contribution of each component
Under the same initialization, Tables 4–6 in the paper isolate the score readout, the interface components (multi-layer features, QKV adaptation, query memory, shared noise), and the optimization rule. Together with Table R1, they show that the image-level reward stage provides the semantic criterion rather than a stronger generator, and that the gains come from subsequent generation optimization, where latent feedback consistently improves over image-level rewards.