- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
TraceGate nests two known acceleration techniques for video DiTs—outer block-stack residual caching and inner sparse attention with temporal route maintenance—and claims as its contribution a feedback path by which the inner planner's action-history score η modulates later outer reuse decisions. Reported speedups reach 3.36×/2.45×/3.02× on Wan 2.1, Wan 2.2, and HunyuanVideo.
Critical strengths
-
The observation-timing analysis (conditioning drift observable pre-decision; Q/K routing observable only post-execution) is crisply stated and correctly frames why any feedback must be delayed.
-
The system-level speedups are substantial and training-free, and the paper is unusually candid about the limits of its own experiments.
Critical weaknesses
-
The framework optimizes per-layer normalized gradient singular energy without establishing its link to downstream loss. Normalizing per layer discards gradient magnitudes, treating layers with vanishingly small gradients equally to task-critical ones. Furthermore, the theoretical proofs are standard fractional-knapsack/KKT derivations that only guarantee the optimality of this unproven surrogate objective, offering limited theoretical depth.
-
Applying SVD to the averaged gradient of high-loss samples is methodologically questionable. Per-sample gradient directions can cancel out in the mean, distorting the singular spectrum, and high-loss samples often over-represent outliers. A more principled estimator of the expected gradient spectrum such as the uncentered second moment is neither used nor compared against.
-
Without a random non-uniform allocation baseline (or standard sensitivity baselines), it is unclear whether the gains stem from SEA’s specific scoring or simply from generic non-uniformity. Moreover, in the most practically relevant setting (LoRA), improvements are marginal or tied with baselines, missing standard deviations to verify significance, alongside an unexplained training-time discrepancy (Table 4) under a matched parameter budget.
Questions for authors
- Why use the SVD of the mean gradient rather than the second moment , and why normalize energy per layer instead of weighting by gradient magnitude ? Please provide ablations comparing against both alternatives.
- Can you include a random non-uniform rank allocation baseline at a matched budget to prove that SEA's specific ordering drives the performance gains?
- Could you report standard deviations for the LoRA benchmarks to establish statistical significance, and clarify why SEA-LoRA is significantly faster per epoch than vanilla LoRA (48m vs. 1h08m in Table 4) despite having the same trainable parameter budget?
Request for Clarification on Review Scope
Dear Reviewer Tf7U,
Thank you for taking the time to provide this detailed review. We have carefully compared each point with our manuscript and would be grateful for clarification regarding how the reviewed components relate to Submission 4177. Our work focuses on training-free acceleration for video diffusion, specifically stack execution versus cached-residual reuse, sparse-attention routing, and action-history feedback.
Critical Weakness 1. We were unable to identify a component in our manuscript that optimizes per-layer normalized gradient singular energy or analyzes such an objective through fractional-knapsack/KKT derivations. Our method instead controls runtime execution and residual reuse. We would welcome clarification if a particular section or equation was intended.
Critical Weakness 2. Our method does not use SVD of an averaged gradient of high-loss samples, estimate a gradient second moment, or select samples for spectral estimation. The controller uses runtime conditioning, residual, and routing information. We would therefore be grateful to know which component of our method the reviewer had in mind.
Critical Weakness 3. We were unable to locate SEA-specific scoring, random non-uniform rank allocation, LoRA benchmarks, or the corresponding Table 4 training-time comparison in our submission. The relevant controls in our paper concern equal tuning effort and direct execution-versus-residual-reuse decisions.
Question 1. Since our method does not use SVD of mean gradients or normalization of per-layer gradient energy, we are uncertain how the requested comparison with a second-moment estimator applies to our submission.
Question 2. A random non-uniform rank-allocation baseline concerns a rank-allocation setting that our method does not use. The closest matched-budget test in our work compares controller signals and execution decisions under comparable tuning effort and runtime.
Question 3. We were unable to identify the reported LoRA standard deviations, SEA-LoRA training times, or trainable-parameter budget referenced in this question. Consequently, we cannot provide a meaningful explanation for the 48-minute and 1-hour-8-minute values.
If these points refer to a different manuscript, we would greatly appreciate confirmation. If any point does correspond to Submission 4177, could you kindly identify the relevant section or equation so that we can provide a precise response?
Thank you again for your time and assistance.