- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes Trajectory-Consistent Calibration (TCC) to correct feature errors in cache-accelerated diffusion models. TCC fits closed-form transformations from paired cached and full-computation features, estimating them sequentially so that later corrections account for trajectory changes caused by earlier ones. Experiments on PixArt-α and DiT-XL/2 show FID improvements over the evaluated cache baselines, with additional computation and latency overhead.
Critical strengths
The design reasonably accounts for the fact that earlier corrections alter the subsequent generation trajectory during calibration.
Critical weaknesses
[W1] Limited insight
The paper offers a limited take-home message.
a) Presentation is one contributing factor. Figure 2, which should explain the method, is difficult to follow. It primarily consists of conceptual blocks, whereas the main text relies heavily on equations, making the connection between the two unclear. The text in the figure is also too small. Analyses motivating the proposed method are either insufficient or not presented where they would best support the motivation, as in the case of Figure 3.
b) The insight gained over existing calibration methods is limited. My understanding of the central message is that earlier corrections alter the generation trajectory, so subsequent corrections should be estimated accordingly. However, the paper does not analyze when or to what extent this mismatch occurs, or how much it has limited the performance of existing methods.
[W2] Limited experimental evaluation
The evaluated models, caching baselines, and offline plug-in baselines are all limited, and the results raise questions about the practical utility of this work.
a) PixArt-α is outdated as a text-to-image model, making it difficult to assess the method’s effectiveness on current models. In the qualitative comparisons in Figures 1 and 6, even the full model’s outputs appear substantially worse than those of state-of-the-art models.
b) FORA and ToCa are not state-of-the-art caching baselines, and many subsequent methods have been published. In particular, Table 1 shows that ToCa’s latency reduction is much smaller than its FLOPs reduction, making it a weak baseline for demonstrating practical acceleration.
c) Comparisons with offline plug-in methods, which are the most directly relevant baselines, are scarce or absent. Only EOC is evaluated on DiT-XL/2, and no such baseline is evaluated on PixArt-α.
d) The experimental results raise questions about the need for this work. TCC increases TFLOPs by over 10% in some settings, yet it is difficult to determine whether the reduction in FID is substantial because there are no comparisons at similar speedups. For example, in Table 1, a fair comparison would require decreasing FORA’s N to match the speedup of FORA (N=3) + TCC. Conversely, the decrease in CLIP score appears substantial and concerning. For example, HarmoniCa (ICML 2025) reports a CLIP score decrease of less than 0.1 on PixArt-α, whereas applying TCC results in decreases of 0.23 for FORA and 0.58 for ToCa, indicating a critical loss of text alignment.
Questions for authors
[Q1] How much do earlier corrections change subsequent features, and to what extent do these changes increase the mismatch between the fitted calibration operators and the features they encounter during inference?
[Q2] Recent caching methods can also accelerate video generation models while maintaining high quality. Would TCC work well on video generation models?
[Q3] Could you evaluate the method on at least one model capable of generating high-quality images at higher resolutions? I suggest FLUX.
[Q4] Could you evaluate TCC on top of at least two recent state-of-the-art caching baselines? I suggest TeaCache (CVPR 2025) and TaylorSeer (ICCV 2025).
[Q5] Please add comparisons with offline plug-in baselines. At a minimum, a comparison with ICC (CVPR 2025) is needed.
[Q6] Please also evaluate metrics other than FID. Generating 30,000 images for each of the requested settings may be burdensome within the rebuttal period. I suggest ImageReward.
[Q7] The FLOPs values in Tables 1 and 2 appear implausibly low. Are they reported in TFLOPs?
[Q8] In Figures 1 and 6, TCC appears to improve image quality, but it also changes the images considerably, suggesting low SSIM between the outputs before and after calibration. I am not arguing that the corrected images should remain similar to the uncorrected ones; I would simply like to understand why such substantial changes occur.