- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
The paper proposes DC-GEN 2.0. The paper trains DC-AE 2.0 as a family of deep-compression autoencoders on a targeted dataset containing images with small text and small faces, and proposes pyramid-aligned decoder training (PADT) to separate latent channels for low-to-high-frequency reconstruction. The paper adapts FLUX1 and FLUX2 to the DC-AE 2.0 latent space to compare quality and speedup.
Critical strengths
Deep-compression AEs are an important and practical problem, and the paper proposes new improvements on top of a prior series of works.
Critical weaknesses
Novelty is limited.
- The structured latent space was previously proposed in DC-AE 1.5, which masks a random prefix of latent channels to reconstruct full-resolution images. The only essential difference in PADT is that it instead reconstructs images at different pyramid resolutions.
- Another difference from DC-AE 1.0 and 1.5 is the inclusion of targeted data, namely image datasets containing small text and small faces. This is very effective as shown in the paper but constitutes limited novelty.
The experimental results do not support the claims.
- In Table 2, DC-AE 2.0 seems to outperform DC-AE 2.0-structured in reconstruction.
- In Table 4 (the main results), DC-AE 2.0-structured does not clearly outperform DC-AE 2.0 (non-structured) for FLUX2-dev. DC-AE 2.0 (non-structured) even clearly outperforms DC-AE 2.0-structured for FLUX1-Krea. It is also highly questionable that the paper does not include DC-AE 2.0 (non-structured) as a comparison for FLUX2 at 4096px.
- The results do not support the claim that PADT contributes to either reconstruction or downstream diffusion, which undermines the main contribution of the paper.
The measurement of speedup is not convincing.
- In Table 4, speedup and throughput are measured only for the DiT, without including the VAE component. This is concerning because DC-AE can be more computationally expensive than the original FLUX-VAE and should therefore be included in the measurement. Alternatively, a separate comparison of the speed of DC-AE and FLUX-VAE should be provided.
The training comparison is not fair.
- In Table 4, the compared FLUX model with the original AE is not fine-tuned at all, whereas the FLUX models with DC-AE 2.0 are fine-tuned on a custom dataset. This is no longer a fair comparison because the gain may result from the dataset rather than the change in latent space. The authors should at least fine-tune the FLUX model using the matched dataset for the same number of epochs.
Questions for authors
Please address the concerns listed in critical weaknesses section.
5 comments
Official Comment by Authors (2/2)
2 Novelty and contributions
PADT design
PADT addresses a practical limitation of the DC-AE 1.5 structured-training recipe: supervising short channel prefixes against full-resolution images degrades reconstruction quality. We propose a new training design that jointly aligns channel budgets, decoder stages, and target scales, matching reconstruction demands to the available channel capacity and decoder depth. The controlled comparison above demonstrates its benefit for recovering reconstruction quality while retaining structured latents for better generation performance. This improved reconstruction fidelity raises the potential quality ceiling for downstream generation.
Engineering and community contributions
Targeted data curation and post-training are engineering contributions of this work. Applying these existing techniques effectively in deeply compressed latent spaces requires nontrivial adaptation and tuning of the training stages, data composition, and balance between training targets. Tables 3 and 5 quantify the benefits of targeted data for reconstruction and generation: OmniDoc PSNR increases from 24.1228 to 26.6615, and Chinese LongText-Bench increases from 0.0745 to 0.9290. Table 9 further shows the benefit of our post-training pipeline for text and face generation. We will release our pipeline and the resulting models, providing the community with reusable resources for efficient high-resolution generation and further research.
3 End-to-end generation speed
Thank you for pointing this out. We agree that DiT-only measurements do not fully capture generation efficiency. We have replaced them with end-to-end measurements, including text encoding and AE decoding, and updated Table 4, Section 4.3, the abstract, and the speedup charts in Figure 1 accordingly. All measurements use a single GB300 GPU, BF16 precision, and 20 sampling steps. Including these costs, FLUX.2-dev with DC-AE 2.0 achieves speedups of 3.33× and 6.60× at 1024 × 1024 with f32 and f64, respectively, and 48.5× at 4096 × 4096 with f64.
4 Training comparison with native FLUX.2-dev
Thank you for highlighting this confounding factor. Table 4 compares our complete system with the original FLUX.2-dev, but this comparison alone does not isolate the effects of targeted-data fine-tuning from those of autoencoder adaptation. To address this concern, we additionally fine-tuned FLUX.2-dev with its original autoencoder on the same targeted dataset using the same training settings and number of iterations. Targeted-data fine-tuning substantially improves the original model’s text-rendering performance, particularly in Chinese. Our adapted model nevertheless achieves higher scores on all four metrics.
| Autoencoder | AE setting | Training | LongText EN ↑ | LongText ZH ↑ | TextPecker EN ↑ | TextPecker ZH ↑ |
|---|---|---|---|---|---|---|
| Original AE | f8c32 | Original | 0.9506 | 0.7526 | 97.23 | 73.94 |
| Original AE | f8c32 | Fine-tuned | 0.9578 | 0.9237 | 97.67 | 85.78 |
| DC-AE 2.0-Structured | f32c128 | Adapted | 0.9692 | 0.9467 | 98.03 | 87.81 |
I appreciate the authors' response. However, my overall assessment of the paper remains borderline. My primary concerns are as follows:
-
PADT yields only marginal improvements in generation quality. This raises the question of whether the significance of the contribution justifies the additional engineering complexity. For example, training PADT VAE also incurs additional computational costs due to the pyramidal alignment loss, a factor that is not considered at all in the paper. If the method demonstrated substantial improvements, it would provide a stronger case for acceptance. Unfortunately, the reported gains are not sufficiently convincing.
-
Dataset curation appears to play a much larger role than PADT in improving generation quality. I appreciate the authors providing additional results from fine-tuning FLUX2 on the same curated dataset. However, these results further suggest that dataset curation is a much more significant factor in improving model quality than the proposed PADT technique.
I will reserve my final rating for now and remain open to further discussion with the other reviewers.
Official Comment by Authors (1/2)
Thank you for recognizing the practical importance of deep-compression autoencoders and our efforts to improve them. Below, we first present reconstruction and generation evidence for PADT, then clarify our contributions. We also report end-to-end generation speed and compare against FLUX.2-dev fine-tuned with its original autoencoder under matched training settings.
1 Experimental evidence for PADT
Structured latent spaces help diffusion models learn high-dimensional latents under deep compression. However, the original DC-AE 1.5 structured-training recipe leads to a loss of reconstruction quality, which can limit the fidelity of downstream generation. We propose PADT to address this issue, aiming to achieve reconstruction quality comparable to standard DC-AE 2.0 while retaining structured latents. Table 2 evaluates this objective through comparisons with both the original DC-AE 1.5 recipe and standard DC-AE 2.0. To further assess the downstream benefits, we have expanded the standard-versus-Structured comparisons in Table 4 and added class-conditional ImageNet generation experiments.
Reconstruction quality
As intended, DC-AE 2.0-Structured achieves reconstruction quality comparable to standard DC-AE 2.0 at f32c128 while retaining structured latents, consistent with our statement in Sec. 4.2. Across the three benchmarks, the absolute PSNR differences are below 0.022 dB. Compared with the original DC-AE 1.5 structured-training recipe under identical initialization, training data, and training settings, PADT improves all reported reconstruction metrics by a large margin (Table 2). On ImageNet, FFHQ, and OmniDoc, respectively, PSNR increases by 0.6271/0.6863/0.3679 dB.
ImageNet
FFHQ
OmniDoc
Generation quality
Our focus is fine-grained detail generation under deep compression. GenEval and DPG-Bench primarily evaluate prompt alignment, whereas LongText-Bench directly evaluates text rendering. LongText-Bench is therefore a primary benchmark for assessing the benefits of Structured latents for fine-grained detail generation.
To provide more complete standard-versus-Structured comparisons, we expand Table 4 with standard DC-AE 2.0 f32c128 results for FLUX.1-Krea at 1024 × 1024 and standard DC-AE 2.0 f64c128 results for FLUX.2-dev at 4096 × 4096. The paired results below show consistent LongText-Bench gains across the evaluated backbones, AE settings, and resolutions, supporting PADT's effectiveness for fine-grained generation under deep compression.
FLUX.2-dev, 1024 × 1024
FLUX.2-dev, 4096 × 4096, f64c128
FLUX.1-Krea, 1024 × 1024
The original FLUX.1-Krea comparison used standard f32c32 and Structured f32c128, which differ in channel count. The higher score at f32c32 is consistent with lower-dimensional latents being easier for the smaller FLUX.1 backbone to learn. As shown in the table above, we have added standard f32c128 to compare the two variants at the same channel count. Structured still achieves a higher LongText-Bench score (0.8658 vs. 0.8607), consistent with the improvements observed in the other matched comparisons.
Beyond text-to-image generation, we additionally evaluate class-conditional generation on ImageNet. At the same f32c128 configuration, DC-AE 2.0-Structured reduces FID from 39.92 to 25.33 compared with standard DC-AE 2.0, providing complementary evidence of its generation benefits.