- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes InterGRPO, an RL framework for improving models that generate sequences of alternating text and images. It argues that each generated image should receive feedback based on both its individual quality and the coherence of the entire sequence. It also introduces UC-Reward, a reward model designed to reduce unreliable quality assessments from vision-language models. The results show that InterGRPO improves performance over the ILLUME-X baseline on some benchmarks.
Critical strengths
The paper is generally well-written and clearly organized, making the motivation and proposed methodology easy to follow. The introduction of UC-Reward is also an interesting aspect of the work. In particular, the use of uncertainty-aware score distribution distillation and repeated evaluation of ambiguous samples may provide a reasonable approach to improving reward reliability, although the entire reward calibration pipeline seems too complicated and requires further ablation to validate.
Critical weaknesses
The proposed InterGRPO framework has limited methodological novelty, as its core global-local credit assignment mechanism is essentially a straightforward extension of standard GRPO. Specifically, the method combines a trajectory-level global advantage with an image-level local advantage through a weighted sum, while retaining the standard GRPO optimization objective. Incorporating local and global rewards is a well-established idea in reinforcement learning, and the proposed formulation does not introduce a fundamentally new credit assignment mechanism. Moreover, the local reward is simply an aesthetic score assigned to each generated image, which is then applied uniformly to its diffusion steps. This does not explicitly address the more challenging credit assignment problem arising from dependencies across different generated units, such as determining which earlier image or generation decision is responsible for inconsistencies in later outputs. The fixed weighting between global and local advantages also appears heuristic and lacks sufficient justification. While adapting GRPO to multi-unit interleaved generation is practically useful, the proposed training framework appears largely incremental, and its claimed methodological contribution is not sufficiently distinguished from existing RL approaches that incorporate rewards at different granularities.
Questions for authors
The current ablation study (Figure 4) primarily compares training reward trajectories under different configurations. However, improvements in training reward do not necessarily translate into better generation quality, particularly when the reward model itself is being changed. Can the authors report downstream benchmark results (e.g., SIL-Bench and ISG-Bench) for global-only GRPO with UC-Reward, global-local GRPO with UC-Reward, and ideally local-only GRPO? This would clarify whether the reported improvements primarily originate from the proposed credit assignment mechanism or from the stronger reward model. In addition, evaluating these variants using a common independent evaluator would provide stronger evidence of the effectiveness of the proposed optimization framework.