- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
QuaDiT proposes a spatially adaptive representation for high-resolution scientific image–mask synthesis. An edge-guided quadtree assigns a fixed budget of variable-sized patches, which a shared autoencoder maps to uniform latent tokens. A geometry-aware diffusion transformer generates tokens conditioned on layouts sampled from training images. Image and semantic heads decode shared features, with the semantic head trained using simulator-provided labels. Experiments demonstrate improved concrete CT image generation and reduced generative-model training cost at 4K, image synthesis at 8K, and additional results on synthetic hydrogel images. Quantitative mask evaluation is conducted on encoded simulator images.
Critical strengths
-
A practically consequential improvement in high-resolution generation efficiency: At 4K, QuaDiT uses 1,501 tokens versus 4,096 for dense DiT-RF, achieving 2.25× training throughput and reducing peak memory.
-
Substantial image-quality gains supported by useful diagnostics: The main baseline shares the modern rectified-flow recipe, making this stronger evidence than comparison only with the original DDPM recipe. KID supports the same ranking, and native-patch evaluation examines detail obscured by whole-image resizing.
Critical weaknesses
-
This paper is mainly focused on Scientific Image and Mask Generation but after reading the paper, I think the method can be used to generate common images. It is unclear if the QuadDiT method can be applied to regular images such as LAION-5B High-Res dataset.
-
Lack of comparison with recent pixel-space diffusion models such as PixNeRD, PixelGen, etc. To me, it is unclear how does this latent-based diffusion model compared to recent SOTA pixel-space diffusion methods. I would consider training those method on the 2K and 4K settings of S8C to have a fair comparison with the proposed method.
-
The method seems like a combinations of existing methods. I do not see new and interesting components in both quadtree image representation, autoencoder and DiT architectures. They are very similar to previous works
Questions for authors
- Additional explanations would strengthen the paper but I am not convinced yet about the novelty aspect of the proposed architecture.
- I would like to see comparison with recent pixel space diffusion on common high resolution image dataset.