- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RiT studies a training recipe for a modernized standard DiT operating in frozen representation space. It combines element-wise standardization, x-prediction, a dimension-aware time distribution, and joint diffusion of global and patch features, without a representation-specific wide head or non-Euclidean transport. Experiments on class-conditional ImageNet 256×256 show improved FID relative to a matched-encoder/decoder RAE baseline and useful few-step sampling. The paper also analyzes representation spaces using intrinsic-dimension estimates, covariance spectra, and kurtosis, and reports transfer to SigLIP2 features.
Critical strengths
-
A useful implementation reference with controlled component comparisons. The paper presents a relatively simple recipe and reports improvements over the RAE-XL DINOv2-S baseline at the same encoder, decoder, and denoiser parameter count: FID decreases from 1.87 to 1.45 without guidance and from 1.41 to 1.14 with guidance. The within-code ablations also show separate benefits from x-prediction and CLS diffusion. These results establish some practical value for the recipe.
-
Clear presentation of the empirical scope. The manuscript documents sampling grids and several implementation choices, and acknowledges the descriptive nature of its geometry measurements and the distinction between epochs and compute. This helps readers interpret and potentially reproduce the experimental findings.
Critical weaknesses
-
Limited new insight beyond combining established components. Standardization and dimension-dependent shifting are inherited from RAE/SD3, x-prediction follows JiT, and joint semantic-token diffusion follows REG. Moreover, the matched RAE-XL DINOv2-S baseline already omits a wide head, so removing such a head is not a new simplification relative to that baseline. The paper mainly establishes that this combination works, without deriving a sufficiently clear mechanistic explanation or transferable design principle. The geometry diagnostics remain correlational, the time-distribution ablation changes both the base distribution and its shift, and the CLS gain is not separated from additional-token or auxiliary-supervision effects. Given the limited component novelty, these gaps substantially limit the research contribution.
-
The empirical advantage is insufficient to compensate for the limited conceptual contribution. RiT’s headline guided FID of 1.14 does not improve on the original RAE result of 1.13; its longer EDM sampling configuration in Appendix M also reaches 1.13. The original RAE comparison uses a larger DINOv2-B model with a wide head and AutoGuidance, so this is a comparison of best reported performance rather than a matched-setting test. RiT’s smaller model and improvement over RAE-S deserve credit, but a compelling quality–compute advantage over the strongest RAE configuration is not established under a common evaluation. Likewise, epoch savings are not measured compute savings, and the few-step baselines retain different samplers. With evaluation limited to ImageNet 256×256, the demonstrated practical advance is not strong enough to establish the significance of an otherwise largely empirical recipe.
Questions for authors
- What generalizable insight does the paper establish beyond showing that known components work well together? In particular, what evidence separates the CLS token’s semantic contribution from auxiliary supervision, and the time shift from the changed base distribution?
- Can the authors reconcile their reproduced RAE FID of 1.16 with the original report of 1.13, and clarify the remaining quality–compute advantage when guidance, sampling budget, and evaluation are made comparable? This clarification could establish whether the practical simplification provides a sufficiently consequential contribution despite similar best FID.