- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This article introduces the Short-Circuit VAE (SC-VAE), which upsamples 2×/4× in the latent space by reusing some layers of a pre-trained VAE decoder and encoder, thus avoiding extra iterations or patch-wise denoising in high-resolution diffusion. The method uses a two-stage training in both latent space and pixel space, and experiments are conducted on FLUX, FLUX2, and SD3.5. The results show that SC-VAE can achieve competitive high-resolution generation quality at a lower inference cost, and ablation studies also support the effectiveness of its architecture design and training strategy.
Critical strengths
- The structure is simple and efficient. It uses the internal layers of a pre-trained VAE for latent upscaling, avoiding extra high-resolution diffusion steps and giving a clear boost in computational efficiency.
- The experiments are pretty thorough. They cover multiple diffusion/VAE architectures and include ablation studies and user studies, which somewhat back up the method's effectiveness.
Critical weaknesses
- The novelty compared to existing methods isn't very clear. LUA already uses single-pass latent upscaling and similar multi-stage training strategies, so this paper's main new idea seems to be just reusing internal VAE layers. The paper lacks a strict comparison of parameter counts, training costs, and model capacity, so it doesn’t fully prove that this design brings real technical improvements.
- The fairness of the 4K experiments needs clarification. The 4K test set in the Supplementary comes from MultiAspect-4K-1M, which UltraFlux also used for training. So it needs to be clear if the test images were fully separate from UltraFlux’s training data, otherwise the comparisons in Table 1 might be contaminated. Also, SC-VAE doesn’t outperform UltraFlux on some 4K quantitative metrics.
Questions for authors
Are the 1,000 images in the 4K test set completely excluded from UltraFlux's training data? Please explain the specific data split.
How many trainable parameters and total training compute does SC-VAE have? Is it possible to make a fair comparison with LUA in terms of parameter count/compute?
Why wasn't there a comparison with recent methods specifically aimed at high-resolution latent decoding/upscaling (like PiD)?
The paper says the VAE is frozen, but the training section mentions that the decoder upscaling block is fine-tuned. Please clarify which parameters are frozen and which ones are trained.