- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces UniFlux, which aims to extend the pre-trained MM-DiT image generation model into a unified model capable of multimodal understanding, reasoning, and image generation. The authors first modify the text stream of MM-DiT using block-wise discrete flow matching, enabling the model to generate lengthy reasoning and responses step-by-step (block by block) while retaining its original image generation capabilities. In the second stage, the authors propose X-GRPO, a method that combines text-side response quality with image-side regeneration quality for reinforcement learning, allowing visual generation feedback to provide a backward constraint on text-based reasoning. Experiments conducted using FLUX.2-Klein 9B and FLUX.2-Dev 32B demonstrate strong performance across multiple benchmarks, including visual understanding, multi-image reasoning, OCR, and image generation.
Critical strengths
-
The paper presents a compelling idea by extending the existing MM-DiT text stream for visual understanding and language reasoning, without introducing a separate language decoder.
-
Block-wise discrete flow matching and X-GRPO complement each other well. The former supports causal long-form reasoning, while the latter uses image-generation feedback to better align understanding and generation.
-
The experiments are extensive, covering visual understanding, multi-image reasoning, OCR, and image generation. The ablations also provide clear evidence for the contributions of the main components.
Critical weaknesses
-
Figure 1 contains some of the most important information in the paper, but it is noticeably blurry and difficult to read. Given its central role in presenting the overall framework, a high-resolution or vector version would substantially improve readability.
-
The methodological novelty appears somewhat incremental. Several key ingredients, including block-wise diffusion, GRPO-style optimization, and joint understanding-generation training, have been explored in prior work. The main contribution therefore seems to come from adapting and combining existing techniques within the MM-DiT framework rather than introducing a fundamentally new modeling principle.
-
Table 1 mainly compares UniFlux with existing unified multimodal models and a few earlier understanding-only models. Although direct comparison with stronger recent multimodal LLMs may not be fully fair because of architectural and training differences, including such results would still provide a useful reference point and help readers better understand the remaining performance gap and potential room for improvement.
Questions for authors
Could the authors clarify the main methodological novelty of UniFlux compared with prior block-wise diffusion and GRPO-based multimodal training?
2 comments
Response to Reviewer 3Qdn (2/2)
W3. Stronger Understanding Baselines.
We have expanded Table 1 to include BLIP-3-4B, InternVL3-8B, and MiniCPM-o-4.5 (Instruct) as additional visual-understanding references. The comparison covers all six understanding benchmarks in Table 1, providing broader context beyond unified understanding-and-generation models.
| Model | MS-COCO CIDEr ↑ | VQAv2 Acc ↑ | MME-P ↑ | GQA Acc ↑ | MMMU Acc ↑ | MathVista Acc ↑ |
|---|---|---|---|---|---|---|
| BLIP-3-4B | 50.11 | 42.39 | 1310.00 | 45.67 | 41.10 | 39.60 |
| InternVL3-8B | 70.69 | 66.53 | 1748 | 51.22 | 62.70 | 71.60 |
| MiniCPM-o-4.5 (Instruct) | 69.34 | 61.47 | 1399.00 | 59.52 | 67.60 | 80.10 |
| UniFlux-9B | 73.33 | 76.78 | 1472.00 | 73.17 | 68.82 | 80.43 |
Among the listed configurations, UniFlux-9B achieves the highest score on all six benchmarks. Compared with MiniCPM-o-4.5 in Instruct mode, it achieves gains of 1.22 percentage points on MMMU and 0.33 percentage points on MathVista, while also supporting image generation. We present these comparisons as performance references, with model configurations explicitly identified, recognizing the architectural and training differences highlighted by the reviewer.
We thank the reviewer for the constructive feedback and encouraging assessment. The clearer distinctions from prior methods and expanded comparisons with recent VLMs strengthen the presentation and clarify UniFlux’s architectural and cross-modal optimization contributions. We hope these revisions reinforce the reviewer’s support and merit a stronger recommendation.
Response to Reviewer 3Qdn (1/2)
We thank the reviewer for appreciating the extension of the MM-DiT text stream without a separate language decoder, the complementary roles of block-wise DFM and X-GRPO, and the breadth of our evaluations and supporting ablations.
W1. Figure Readability.
We thank the reviewer for noticing this. We are working to revise the figure in the main paper with vector image and try to zoom the images to improve readability.
W2/Q1. Methodological Novelty.
Our technical contribution lies in adapting a pretrained image generator for explicit multimodal reasoning and coupling its understanding and generation through a specific credit-assignment mechanism. Concretely:
Turning the MM-DiT’s conditioning stream into a language-generation pathway. Our architectural contribution is enabling a pretrained image-generation backbone to produce visually grounded answers through its existing text stream. We introduce trainable token embeddings and a vocabulary prediction head to decode the visually conditioned text representations already processed by the MM-DiT. LoRA adaptation and block-causal discrete flow matching enable sequential reasoning across blocks and parallel refinement within each block, while retaining the native continuous image-generation pathway. This provides language output within the existing backbone without adding a separate autoregressive response decoder.
Generation feedback for understanding through X-GRPO. The main methodological novelty is X-GRPO’s assignment of joint credit to an understanding response and its associated image generations. Each sampled response, together with the source image and query, produces an image-generation instruction. The generated images provide complementary feedback for optimizing the originating text response. Our specific contribution is the cross-modal weighting: w{ij}={sg}([{^A}Ti]+[{^A}I{ij}]+). Text and image rewards are normalized separately, and their coupled weight guides both policy objectives. Positive credit requires both advantages to be positive: a high image reward cannot compensate for a nonpositive text advantage, or vice versa. This specifies how the two tasks influence each other during optimization.
The ablations support these specific design choices. Replacing block-wise generation with full-sequence denoising reduces MMMU from 68.82 to 65.37. Positive-gated text-only RL achieves 66.54 MMMU / 0.85 GenEval, while X-GRPO achieves 68.82 / 0.91. Alternative coupling rules also perform worse: additive advantages achieve 64.03 / 0.86, and a signed product achieves 63.12 / 0.82. These comparisons support the value of both the causal text-generation design and the particular cross-modal objective.
Compared with prior block-wise diffusion: Block-wise diffusion establishes sequential generation across blocks and parallel refinement within blocks. UniFlux adapts this mechanism to the pretrained MM-DiT’s visually conditioned text stream using trainable answer embeddings, a vocabulary head, and block-causal discrete flow matching. This allows the backbone to generate reasoning and answers conditioned on the image and completed response blocks while retaining its continuous image-generation pathway. The contribution here is the architecture and training formulation that support these two generation processes within the pretrained backbone.
Compared with prior GRPO-based multimodal training: Existing approaches include applying task-specific rewards across reasoning and generation tasks, as in MMaDA, and using generated-image rewards to optimize textual planning and image generation, as in T2I-R1. More precisely, in T2I-R1, the model produces a textual plan and then an image. The generated image is scored, and that score is used to train both the textual plan and image generation. The plan is therefore rewarded indirectly through the resulting image. X-GRPO introduces a different rule for connecting the two tasks:
Each sampled understanding response is linked to associated image generations.
The answer and images are scored separately and compared with their respective sampling groups.
Their positive advantages are multiplied, and the resulting weight trains both pathways.
Thus, an answer–image pair receives positive credit only when both the answer and image score above their respective group averages. A highly rewarded image cannot compensate for a below-average answer, and a highly rewarded answer cannot compensate for a below-average image. This is the specific methodological distinction: both evaluations jointly determine the reinforcement assigned to each linked response–image pair.