- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PatchBridge, a pixel-space diffusion Transformer that explicitly decouples three roles traditionally served by a single patch grid: global semantic context, persistent denoising state, and late-stage fine-detail refinement. The model implements this design through three coordinated streams, each with a patch size and lifespan tailored to its role: a semantic stream that uses coarse patches and is updated at only a few stages; a structural stream that uses medium-sized patches and persists throughout the network; and a detail stream that uses fine patches and is activated only in the final K blocks. Adjacent streams communicate through bidirectional cross-scale interactions, including parent-to-child spatial modulation and child-to-parent pooled feedback. In addition, an overlapping clean-image readout allows neighboring fine-grained tokens to jointly predict pixels in overlapping regions. PatchBridge achieves strong results on ImageNet class-conditional generation at resolutions of 256 and 512, as well as in a text-to-image setting with relatively limited training data. Ablation studies also demonstrate the contributions of individual components.
Critical strengths
-
The paper proposes a clear and practically meaningful approach to jointly allocating spatial granularity and processing depth. Decoupling patch roles through three streams operating at different scales and with different lifespans is a simple and well-motivated way to address the competing demands of global context, persistent denoising, and local detail in pixel-space DiTs.
-
The experiments cover multiple model sizes, image resolutions, and conditional generation tasks, demonstrating broad applicability.
Critical weaknesses
-
The experimental comparisons are not sufficiently clear or complete. In Table 1, the number of function evaluations (NFE) should be used to compare sampling costs fairly. Under this accounting, JiT and PixelU should both be reported as 100 × 2 due to classifier-free guidance (CFG). The paper therefore lacks a clearly established comparison under equivalent sampling budgets. Meanwhile, the Precision and Recall for papers such as PixelU are missing in the table. In addition, it lacks a strictly comparable result at approximately 800M parameters against the strong PixelDiT-XL/16 baseline, which achieves an FID of 1.54 with 800M parameters after 800 training epochs, as reported in its appendix.
-
The advantages of the proposed network architecture are not sufficiently demonstrated. More comprehensive comparisons with other representative architectures, such as Deco[1],HyperDiT[2], and PixelDiT[3], should be included under comparable computational budgets, rather than only comparing against JIT. In particular, HyperDiT is highly relevant as it also explores the decoupling of semantic information and fine-grained details, employing collaborative designs with different patch sizes to enhance representation capability. Furthermore, FLOPs should be reported for more model sizes, especially the H-sized model in 512 * 512 resolution .
References
[1]Ma Z, Wei L, Wang S, et al. Deco: Frequency-decoupled pixel diffusion for end-to-end image generation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026: 43600-43610.
[2]He Y, Ma L, Guo Z, et al. Hyperdit: Hyper-connected transformers for high-fidelity pixel-space diffusion[J]. arXiv preprint arXiv:2605.15741, 2026.
[3]Yu Y, Xiong W, Nie W, et al. Pixeldit: Pixel diffusion transformers for image generation[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026: 14273-14282.
Questions for authors
In addition to the Weaknesses raised above:
-
Does the semantic stream make a substantial contribution? Using a larger patch size but a smaller hidden dimension may lead to substantial information loss. Table 5 also suggests that including or excluding the semantic stream has only a small effect on the results, potentially smaller than the variation across random seeds.
-
The functional division of "semantics/structure/details" is mainly focused on design interpretation, lacking direct verification, such as visualization or clustering of its features.
-
Both the asymmetrical flow models[1] and EG-FM[2] mentioned that the FID evaluated using JiT would be lower. The other methods in Tables 1 and 2 were evaluated using ADM. What were the results of PatchBridge evaluated using ADM?
-
Is there a qualitative result for T2I?
References
[1]Chen H, Ackermann J, Kim M, et al. Asymmetric Flow Models[J]. arXiv preprint arXiv:2605.12964, 2026.
[2]Tong H, He Y, Li F, et al. Energy-Guided Flow Matching[J]. arXiv preprint arXiv:2608.05811, 2026.