- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RoAR-VAE, a modification to the REPA-E training pipeline that identifies that the joint training objective of REPA-E is generally unnecessary, and that the benefits of REPA-E style VAE training almost exclusively originate from the separate semantic loss as well as input noising. Following this, the authors detach the end-to-end VAE training from a VAE semantic loss. The authors additionally add an additional reconstruction loss. The authors then evaluate across several experiments, first claiming improvement over the REPA-E baseline, as well as strong reconstruction metrics such as PSNR and strong generation metrics such as GenEVAL scores.
Critical strengths
Identifying that the REPA-E VAE does not benefit from the downstream diffusion model training and demonstrating that splitting the component improves performance is a useful takeaway.
The performance on established benchmarks is good, provided that baselines are sufficient. The reconstruction quality, both quantitative and qualitative, is good.
The method is overall simple and well motivated.
Critical weaknesses
I am concerned about the novelty of the method. Prior work such as DeTok [1] perform seemingly every approach in this paper. DeTok contains additive noise to the latent embeddings, a separate (optional) DINO semantic alignment loss, and a MAE style reconstruction decoder. The only difference I see is that the MAE reconstruction in DeTok is weight-tied with the VAE, whereas the RobustReconstruction model here is separate. However, given the extremely minor gains from the RobustReconstruction model in Table 4, I do not believe this difference is sufficient for novelty.
Second, I am concerned about the baselines in this paper. The work is described as an improvement over REPA-E, however in Table 1 the results are marginal at best, losing or tying to REPA-E in half of the reported numbers. Following this, the reported baselines do not include ImageNet for generation. Although it may be argued that ImageNet is outdated or too small a benchmark, this is harmful to the paper because this is a primary setting the baseline is evaluated in. This is compounded by the how the GenEval scores appear inconsistent with those reported for E2E-FLUX-VAE (REPA-E-FLUX) in [2]. What does 35k optimization steps refer to, is this different from the 100k and 500k cited in the provided post? For marginal novelty work (earlier point), I would want to see more rigorous, replicable, and understandable baselines.
[1] Latent Denoising Makes Good Tokenizers, ICLR 2026
Questions for authors
How do the methods provided in this paper differ from an approach like DeTok other than weight tying. Are these differences sufficiently novel to teach the reader something new about tokenization that they would not get from prior semantic alignment works?
Could the authors provide a more consistent baseline showing improvements over REPA-E?