1. Could timestep differences provide an alternative shortcut to Gaussian noise differences?
The paper attributes the failure of InfoNCE to noise-induced feature separation. However, positive pairs have correlated timesteps, while in-batch negatives may come from different timesteps. Since DiT explicitly incorporates timestep information, could the model also exploit these differences to distinguish samples?
Could the authors clarify the timestep sampling strategy and compare InfoNCE and CRAN using timestep-matched negatives? This would help distinguish the proposed Gaussian noise shortcut from a potential timestep shortcut.
2. What is the exact implementation of the CRAN loss and its gradient flow?
In Eq. (4), distance clipping appears to apply to all terms in the denominator, including the positive pair, whereas the text describes clipping only negative pairs. Additionally, Eq. (5) does not specify whether the adaptive anchor is detached from gradient computation.
Could the authors clarify both implementation details and provide the actual loss formulation? These choices directly affect whether negative pairs stop contributing repulsive gradients after reaching the anchor.
3. How does CRAN's negative-pair regularization behave across different noise levels?
Figure 1 shows that negative-pair distances increase with noise strength, while CRAN limits their separation. However, the paper does not quantify how frequently negative pairs exceed the adaptive anchor at different timesteps.
Could the authors report the fraction of clipped negative pairs and the relative positive/negative gradient contributions across noise levels? This would clarify whether CRAN maintains meaningful negative-pair regularization at high noise levels or primarily relies on positive-pair alignment there.
4. Could the authors clarify the experimental settings behind the layer-pairing ablation?
Table 9 reports an FID of 42.9 for student layer 3 and teacher layer 8, whereas Table 21 identifies this layer pair as the default configuration and the main results report an FID of 26.3 on SiT-B/2.
Were these experiments conducted with different training budgets or evaluation settings? Please specify the configurations to clarify how the layer-pairing ablation should be interpreted.
5. How does CRAN compare with Self-Flow under matched experimental settings?
The paper claims the best performance among methods without external pretrained visual encoders but does not compare with Self-Flow (ICML 2026). Self-Flow reports an FID of 5.70 on ImageNet-256 with SiT-XL/2 at 4M steps, compared with CRAN's 6.2.
Could the authors provide a comparison under matched training and evaluation settings, including computational costs? This comparison is important for assessing the claimed state-of-the-art performance.
Response to Reviewer aHXZ
Thank you for your review and we address your concerns below.
1. Evaluation beyond ImageNet and text-to-image generalization (W1 & Q1)
Our evaluation includes two additional image datasets and a motion-generation task. In Appendix C.1, Table 10, CRAN reduces SiT's FID from 6.73 to 5.59 on FFHQ and from 27.6 to 20.5 on WebVision-10-50K. On HumanML3D, CRAN reduces MDM's FID from 0.5320 to 0.3918 for text-to-motion generation (Appendix C.4, Table 13).
To directly address text-to-image generalization, we also evaluate CRAN on MS-COCO using MMDiT.
CRAN improves MMDiT on MS-COCO and achieves a lower FID than SRA.