- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies the effectiveness of x-prediction comparing to v-prediction in Diffusion Transformer equipped with VAE latent space. The authors argue that x-pred supplies a known residual response outside the network and lets the network concentrate on structured clean targets. They support this interpretation with a Gaussian analysis, channel covariance measurements, and competitive results on ImageNet.
Critical strengths
- The paper presents competitive FID score on ImageNet 256x256 dataset.
Critical weaknesses
My main concern is the positioning of the paper.
If the paper aims to identify a problem (i.e. "does this equivalence survive the replacement of an ideal predictor by a finite neural network" in line 78-79) and propose a solution / novel training method (i.e. JLT), the formulation is identical to JiT (Li & He, 2026, Section 4.2, the x-prediction formulation & the time-dependent weighting) with the only difference being training the model in VAE latent space instead of pixel.
If the paper aims to provide theoretical insights on why x-pred works better than v-pred, the proposition 1 is made on an extremely simple case with a multi-variant Gaussian with no practical experimental evidence other than Figure 5, which I believe again overlaps with the message conveyed from Figure 2 in Li & He, 2026.
Either way, unless the authors providing more evidence on how this work establishes itself on top of JiT, I'm leaning towards rejection.
Li, Tianhong, and Kaiming He. "Back to basics: Let denoising generative models denoise." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 36115-36125. 2026.
Questions for authors
Could the author provide concrete evidence on the novelty / technical insights of the paper on top of JiT?