- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Integral, a unified multimodal framework that extends a pretrained vision-language model (VLM) with image generation capabilities while keeping the original VLM backbone frozen. The authors introduce the Propagation-Bottleneck Hypothesis to explain the trade-off between semantic understanding and image reconstruction. To address this, they propose Abstraction Fusion (AF), which aggregates hierarchical features from the frozen vision encoder and learns a shared visual representation through semantic and reconstruction objectives. Additionally, Block-wise MoT reduces generation-specific parameters by interacting with the frozen VLM only at selected block boundaries. Experiments demonstrate competitive performance across image generation and editing tasks while largely preserving multimodal understanding capabilities.
Critical strengths
-
Insightful motivation and promising representation design. The Propagation-Bottleneck Hypothesis provides an interesting perspective on the trade-off between semantic understanding and image reconstruction. Building on this motivation, AF effectively leverages hierarchical features from the pretrained VLM's native vision encoder, achieving strong reconstruction quality while largely preserving its understanding capabilities.
-
Parameter-efficient generation with competitive performance. Block-wise MoT reduces generation-specific parameters while achieving validation Flow Matching losses comparable to Full MoT. The complete Integral system also demonstrates strong performance across multiple image generation and editing benchmarks, highlighting the potential of reusing pretrained VLM capabilities.
Critical weaknesses
- Limited methodological novelty
The main components of Integral build upon established techniques. Aggregating intermediate features from pretrained vision encoders has been widely explored in visual representation learning / visual tokenization. For instance, DualToken [1] also discusses the distinct feature requirements of semantic understanding and visual reconstruction, and proposes leveraging shallow intermediate features for reconstruction and deeper features for semantic representation, while RAEv2 [2] and DecQ [3] similarly fuse multi-layer features to enhance both visual understanding and reconstruction quality. The authors should discuss these closely related works and clarify how their approach differs. Furthermore, semantic reconstruction, pixel-level reconstruction, and variational bottlenecks are all well-established techniques for learning reconstruction-capable visual representations. Similarly, Block-wise MoT primarily adjusts the interaction frequency between modalities within an existing MoT architecture, rather than introducing a fundamentally new generative modeling mechanism.
The paper's more interesting contribution is its hypothesis that preserving and reusing the pretrained VLM's representation hierarchy facilitates knowledge transfer from understanding to generation. However, the current experiments do not sufficiently isolate this mechanism. See below.
- Insufficient ablations to isolate the contributions of key components.
The final generation results are obtained using AF and Block-wise MoT together, making their individual contributions difficult to assess. Figure 3 compares Block-wise MoT with Full MoT only in terms of validation velocity MSE, without reporting downstream generation performance. Moreover, the contributions of multi-layer feature fusion and semantic reconstruction supervision within AF are not sufficiently examined. The relative importance of features from different encoder depths also remains unclear.
- A gap between the main results and the controlled ablation evidence.
While the main experiments demonstrate the competitiveness of Integral as a complete system, the ablation studies are relatively limited in explaining the sources of these improvements. In particular, Figure 4 compares AF with FLUX.1-VAE under the same generation setup, but only during early text-to-image training, without corresponding comparisons on the main downstream benchmarks. Meanwhile, the comparisons with BAGEL and other unified models involve multiple architectural and training differences. As a result, the current evidence does not sufficiently isolate the contribution of AF to the final generation performance, which is important for supporting the paper's central claim about shared visual representations.
[1] DualToken: Towards Unifying Visual Understanding and Generation with Dual Visual Vocabularies, ICLR 2026
[2] Improved Baselines with Representation Autoencoders, Arxiv 2026
[3] DecQ: Detail-Condensing Queries for Enhanced Reconstruction and Generation in Representation Autoencoders, Arxiv 2026
Questions for authors
-
Component contributions and AF design: Could the authors provide downstream generation results for AF + Full MoT, along with ablations on multi-layer feature fusion and semantic reconstruction supervision? Could they also analyze the learned cross-layer attention distributions and the relative contributions of features from different encoder depths?
-
Main results and controlled comparisons: Could the authors provide additional downstream generation comparisons that isolate the contribution of AF under otherwise consistent model architectures and training settings? In particular, extending the controlled comparison in Figure 4 to representative main benchmarks would help establish whether the advantages of AF also contribute to the final system performance.
-
Novelty and related work: What are the key differences between AF and existing multi-layer feature fusion approaches for visual tokenization? Could the authors further clarify the necessity of using the VLM's native visual representations and explicit semantic alignment, and strengthen the discussion of related pretrained-VLM-based generation frameworks, such as BAGEL, LaTtE-Flow, and Bifrost-1?