- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies when visual understanding and generation reinforce or interfere with each other in native unified multimodal models. Through controlled experiments at the representation, task, and system levels, it finds that task-decoupled computation helps balance the two capabilities, related tasks can benefit from joint training, and end-to-end unification can outperform a planner–executor pipeline on reasoning-intensive image editing.
Critical strengths
- The paper systematically studies understanding–generation interactions at the representation, task, and system levels, an important research question for unified multimodal models.
- The controlled architectural comparisons and task-specific experiments provide useful insights into when joint training leads to synergy or interference.
Critical weaknesses
- All experiments use a Qwen3-1.7B backbone. It remains unclear whether the observed interference and benefits of task decoupling persist at larger model scales.
- The paper finds that generation supervision improves visual representations for understanding. Related work has also explored this direction: ROSS [1] improves understanding through image reconstruction supervision, while UniMRG [2] enhances spatial understanding through multi-representation generation. Discussing these connections and clarifying the differences would strengthen the paper’s positioning and rigor.
- Task-decoupled MoT architectures are already used in leading models such as BAGEL [3] and Cosmos 3 [4]. The finding that separating understanding and generation computation helps mitigate interference is therefore somewhat expected.
References:
[1] Reconstructive Visual Instruction Tuning. 2024.
[2] Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation. 2026.
[3] Emerging Properties in Unified Multimodal Pretraining. 2025.
[4] Cosmos 3: Omnimodal World Models for Physical AI. 2026.
Questions for authors
-
Do you expect the observed interference and benefits of task decoupling to persist with larger backbones? Could increased model capacity alleviate the trade-offs observed in your experiments?
-
How does the generation-to-understanding benefit discussed in this paper differ from that explored in existing work?
-
What new insights does your study provide into task-decoupled MoT architectures beyond existing models such as BAGEL and Cosmos 3?
3 comments
The rebuttal has addressed my concerns, and I maintain my positive score.
Thank you for your constructive feedback and continued positive assessment. We are pleased that our rebuttal addressed your concerns and appreciate your time and careful review.
Response to Reviewer CEUe
We thank the reviewer for recognizing the importance of the research question and the value of the controlled experiments. We address the questions below.
A1: Thank you for this suggestion. We have extended the representation-level study to an 8B backbone (Qwen3-8B), covering dense sharing, modality-decoupled MoT, and task-decoupled MoT. The current checkpoints have been trained for 120k steps, with the results summarized below.
The 8B results reproduce the qualitative findings at 1.7B: the balance between understanding and generation depends on routing, with asymmetric interference under shared visual computation and a more balanced outcome under task decoupling. This shows that the observed behavior extends to a substantially larger backbone. We will continue training to the full schedule and add the complete results, together with additional 8B task- and system-level experiments, to the paper.
We thank the reviewer and have added these discussion in Section 6 of our revised paper. The key difference is the nature of the "generation" being studied.
In both cases, the generative task is a re-rendering of the input image, designed as an auxiliary signal for understanding.
Our work studies the intrinsic relation between multimodal understanding and standard generation: text-conditioned natural-image generation and editing, trained as a full task, in a native model without pretrained vision encoders, VAEs or perception teachers. This allows us to ask a different question: when do the two genuine capabilities help each other, and when do they conflict? We find that the answer depends on how computation is shared.
A3: BAGEL and Cosmos 3 address a different goal: how to fit understanding and generation into one model without obvious interference. To achieve this, their visual representations are split rather than unified. Understanding uses a semantic ViT, while generation uses the latents of a separate frozen VAE, and each representation is processed by its own tower. This avoids interference, but it also weakens the connection between the two capabilities. The two tasks do not share a visual representation, and neither work shows that understanding and generation actually improve each other. BAGEL compares Dense / MoE / MoT only by training-loss curves, and neither report compares against single-task models.
Our study asks the complementary question: can understanding and generation reinforce each other when they share a unified visual representation? In our native model, both tasks read and write images through the same pixel-patch interface, learned jointly from scratch, with no separate encoder or VAE.
In short, BAGEL and Cosmos 3 show that separate representations can coexist in one model. We show that a unified representation can deliver mutual improvement, and we identify the conditions under which it does. We have added this discussion in Section 6 of our revised paper.