- Rating
- 1
- Confidence
- 4(+1)
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes ReSPect, a training-free caching method for diffusion transformers. Skip decisions are made by a gate that accumulates the drift of a timestep-dependent Wiener-filtered block input. On skipped steps, the transformer residual, rather than the hidden state, is forecast by blending a ridge-regularized Chebyshev fit with a first-order Taylor extrapolation. Experiments on FLUX.1-dev, Wan2.1-1.3B, and HunyuanVideo show higher PSNR/SSIM and lower LPIPS than TeaCache and TaylorSeer.
Critical strengths
The method achieves high reference similarity on video models.
Critical weaknesses
[W1] Limited Novelty
The proposed method is essentially a combination of two prior works. The “when to skip” component (Spectral-Aligned Gate) is highly similar to the spectrally aligned schedule of SeaCache (CVPR 2026). The “what to fill” component (Residual Forecaster) is highly similar to the Chebyshev prediction of Spectrum (CVPR 2026). I therefore find that the paper offers little to no methodological contribution.
[W2] Limited experimental evaluation
a) Although a substantial part of the method is drawn from SeaCache and Spectrum, Tables 1 and 2 include no comparison with either work.
b) The evaluation relies solely on similarity metrics (PSNR, SSIM, LPIPS). The prior works compared in this paper, TeaCache (CVPR 2025) and TaylorSeer (ICCV 2025), also report image and video quality metrics such as ImageReward or VBench scores, but these are missing here. Following at least the evaluation protocol of prior work is necessary to demonstrate the robustness of the results.
[W3] Presentation
Overall, the figures have poor readability, which makes the paper difficult to follow. In Figure 2, the text is too small, and many symbols appear before they are defined, which is confusing. Figures 3–5 make inefficient use of space. Tables 1 and 2 also do not explain their symbols (δ, S).
Questions for authors
See weaknesses.
3 comments
I thank the authors for the extensive revision. However, my main concern, the limited novelty (W1), remains, and the new results confirm it. I therefore maintain my rating.
The revised paper now states that the gate is SeaCache’s, unmodified, and that the forecaster is Spectrum’s. The remaining distinctions do not explain the gains:
- Residual target: no gain over the hidden state (App. K). The authors themselves “do not attribute the gain to the choice of target.”
- Forecaster: on Spectrum’s schedule, it reproduces Spectrum exactly (25.48 vs. 25.48 dB). On ReSPect’s own steps, Taylor-only outperforms the proposed blend.
- Code: util_seacache.py is identical to SeaCache’s file, and the forecaster is described as a “faithful reimplementation” of Spectrum’s, with Spectrum’s default settings.
The contribution is therefore placing Spectrum’s predictor inside SeaCache’s cache, which I do not consider sufficient for ICLR.
We thank the reviewer for reading the revision and for the follow-up. We agree with the facts listed: the gate is SeaCache's, unmodified; the forecaster reimplements Spectrum's, with its released settings; and the residual target alone brings no gain over the hidden state. The revised paper states all three, and we do not claim them.
What we claim is the cache design: residual caches such as SeaCache copy the cached block residual on skipped steps, whereas ReSPect forecasts it from all evaluated steps, on the content-adaptive steps selected by the gate. The revision isolates both parts:
- Forecast instead of copy (same gate, identical steps): +0.80 dB [+0.65, +0.95] and +0.43 dB [+0.20, +0.66] on FLUX.1-dev (paired 95% CIs), and +0.89 / +0.64 dB on HunyuanVideo (Tab. 3, App. L).
- Content-adaptive instead of fixed steps: with the same forecaster at 18 NFE on FLUX.1-dev, Spectrum's schedule gives 25.48 dB, reproducing Spectrum as it should, and the gate's steps give 26.14 dB (App. K). Against Spectrum itself on video, at matched NFE: +7.9 / +4.5 dB on Wan2.1 and +4.8 dB on HunyuanVideo (δ=0.27) (App. L).
The two observations in the comment support this reading. That the forecaster reproduces Spectrum on Spectrum's schedule shows that the forecaster is unchanged and that the difference comes from the steps it runs on. That Taylor-only outperforms the blend shows that the gain comes from where and when the residual is forecast, not from the particular forecaster: a first-order Taylor forecast reaches 26.5 dB inside our cache, while TaylorSeer reaches 19.68 dB at the same 18 NFE (Tabs. 1 and 3). The settings in which copy-reuse or Spectrum remains ahead are listed in the Limitations.
Response to Reviewer RNgB
We thank the reviewer for the detailed review and for noting ReSPect's high reference similarity on video. All changes are in the revised paper and supplementary (blue).
[W1] Limited novelty. ReSPect builds on SeaCache and Spectrum, and the revised paper states this plainly: the spectral gate is SeaCache's, unmodified, and the Chebyshev–Taylor forecaster and its bounds are Spectrum's (both CVPR 2026, within the four-month contemporaneous window of the ICLR 2027 AC guidelines); polynomial feature forecasting is an active line of work (TaylorSeer, ICCV 2025; HiCache, ICLR 2026; SADA, ICML 2025, at the solver level). Like most methods, ReSPect is built from known parts, and its contribution lies in how the parts are composed: the cache design. We measured each of its choices (FLUX.1-dev):
Placement matters more than the forecaster: a Taylor forecaster on a fixed interval (TaylorSeer) reaches 19.68 dB at 18 NFE, a first-order Taylor forecast of the block residual on our gate's steps 26.5 dB. The composition beats both parents at matched compute: on FLUX.1-dev 26.14 dB at 18 NFE vs. 25.34 (SeaCache) and 25.48 (Spectrum); on video +7.9 / +4.5 dB over Spectrum on Wan2.1 and +4.8 dB on HunyuanVideo (δ=0.27), and +0.89 / +0.64 dB over SeaCache on HunyuanVideo. The revised paper rebuilds its contributions around these findings (Secs. 1–3).
[W2a] SeaCache and Spectrum. Both are now compared, every baseline re-run from its released code in one harness (same prompts, seeds, uncached reference and GPU; no published number reused). FLUX.1-dev, DrawBench-200, 1024², 50 steps:
At 18 NFE ReSPect is best on all three metrics, and it is ahead of SeaCache at both budgets. At 13 NFE the gate skips one of FLUX.1-dev's first five, structure-forming steps; forcing them raises ReSPect to 23.18 dB. The revised paper compares both on every model and budget: Tab. 1 (with TeaCache, TaylorSeer, SADA and fewer steps), Tab. 2 (SeaCache's published video rows) and App. L of the revised supplementary (both on video in one harness, 944 prompts, matched NFE; margins in W1).
[W2b] Quality metrics. The revised paper reports the quality metrics used by TeaCache and TaylorSeer for every model and budget, SeaCache and Spectrum included (App. M of the revised supplementary): ImageReward and CLIP score on FLUX.1-dev, and all 16 VBench dimensions (944 prompts, official code) on Wan2.1 and HunyuanVideo. ReSPect's ImageReward is 1.008 / 0.988 at 18 / 13 NFE (uncached 0.999) and its CLIP score 27.76 / 27.68 (uncached 27.70), both within the paired 95% CI of the uncached model. On VBench, ReSPect stays within 0.2 points of the uncached model's Total at every budget, and at the smaller budget it scores above SeaCache, Spectrum and TeaCache on both models.
[W3] Presentation. We revised each item. (i) Fig. 2 is moved into Sec. 3.2, after the text that introduces its notation, enlarged to full width, and its caption defines every symbol in the paper's notation; (ii) Figs. 3 and 4 now share one row, and Fig. 4 is one quality–compute plot with every re-measured FLUX.1-dev method on a common NFE axis; (iii) the captions of Tabs. 1–2 define δ, N (TaylorSeer's interval, previously S) and α, both tables have an NFE column, and the source of every row is stated. A redrawn Fig. 2 with larger text, and qualitative figures with fewer methods at larger size and the prompt in the caption, follow in the camera-ready version.
We hope the added comparisons and the revision address the reviewer's concerns and are glad to clarify anything further.