- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates the feature drift in the key-value (KV) cache during long-horizon autoregressive video generation. By deriving an exact mathematical decomposition, the authors reveal that the observed spectral concentration of cache features is predominantly driven by the amplification of a shared component across tokens, rather than the loss of token-specific variation. Guided by this diagnosis, they propose "Cache Homeostasis," a training-free inference-time intervention that regulates newly written cache values against an early reference state. Extensive experiments demonstrate that the lightweight Mean controller effectively suppresses abnormal cache growth with minimal computational overhead, while the Full controller offers further text-consistency gains at the cost of higher computation and subject consistency.
Critical strengths
- The paper honestly reports negative results, trade-offs, and unvalidated hypotheses, while the appendix provides exhaustive raw data, algebraic consistency checks, and reproducibility guarantees, setting a remarkably high standard for empirical rigor.
Critical weaknesses
-
The presentation quality is severely compromised by rudimentary figures and overwhelmingly dense, difficult-to-read tables, which strongly appear to have been directly generated or hastily formatted by AI tools without adequate human refinement—a suspicion directly corroborated by the authors' own admission in the "AI USE STATEMENT" regarding their reliance on AI for figure and table preparation.
-
Lack of Causal Link and Limited Predictive Power: Although the paper establishes a raw correlation between shared-energy growth and aesthetic degradation, the authors themselves acknowledge that this association significantly attenuates after temporal detrending.
Questions for authors
See weakness
2 comments
Thank you for recognizing the rigor of our empirical reporting and reproducibility materials. We respectfully ask that the soundness assessment distinguish the validity of our diagnostic and control results from the strength of causal claims about perceptual quality. Our two central contributions can be evaluated independently of a causal interpretation of the energy-quality correlation.
1. An exact diagnostic distinction with quantitative validation. Increasing uncentered feature concentration does not uniquely imply that token-specific variation has collapsed. Our decomposition separates shared energy, mean-covariance alignment and weighted centered variation, allowing their contributions to an observed concentration change to be identified exactly. This resolves an ambiguity that inspecting an uncentered spectrum alone cannot resolve.
The fixed 12-prompt, two-seed study provides quantitative evidence: the shared term accounts for 97.05% of the prompt-averaged concentration increase and more than half of the increase in 23/24 trajectories, with the counterexample retained. The contribution is therefore both a checkable mathematical diagnostic and an empirical characterization of the studied rollouts.
2. A minimum-change control result with an explicit scope. At alpha=1, Mean is the unique update minimizing the Frobenius perturbation among all value matrices whose token mean lies within the specified reference ball (App. B.2). It preserves the centered component, and hence every within-block pairwise token difference, in exact arithmetic. This connects the diagnosed component to a precisely defined intervention while avoiding unnecessary changes to centered variation.
The optimality statement concerns a fixed constraint at a single cache write; perceptual consequences require separate empirical evaluation. Nevertheless, this local optimization result stands independently of whether the observed energy-quality association is causal. Together, the decomposition and projection provide a mathematical basis for distinguishing what changes and controlling that component with minimal perturbation.
3. Interpreting the temporal evidence precisely. The attenuation after detrending limits the causal and predictive interpretation of the energy-quality association. We report it explicitly for that reason. It does not invalidate the decomposition, the measured attribution or the minimum-change property. Our intervention experiments separately evaluate regulation of cache statistics and endpoint-specific output effects, including improvements and unfavorable tradeoffs. We do not present the correlation as proof that shared growth causes perceptual degradation, or as a validated predictor of intervention benefit. We respectfully ask that these distinct claims be assessed on their respective evidence.
4. AI disclosure and presentation. Our account follows the complete AI Use Statement in the manuscript (p. 11). Quantitative results are computed from recorded model outputs through executable analysis; AI-assisted visual descriptions are not human evaluations. The authors are responsible for the final content, claims and artifacts. The use or visual appearance of AI-assisted materials does not, by itself, establish an error in the derivations or results. We welcome specific technical concerns that can be checked against the proofs, recorded measurements and analysis code.
We will also improve readability by focusing the main narrative on the 50-prompt benchmark and fixed 12-prompt attribution study, moving developmental probes and legacy variants to the appendix, simplifying the main tables, and improving figure labels, typography and captions.
5. Ethics clarification and rating reconsideration. The ethics flag currently has no accompanying explanation. Could you please identify the concrete ethical concern, together with the relevant passage, practice or supporting evidence? If the concern relates to AI assistance, specifying the practice at issue would allow us to respond substantively and accurately.
We respectfully ask you to reconsider the rating and soundness assessment in light of the independently checkable diagnostic decomposition, the minimum-change control result, their empirical evaluation, and the clarified scope of our claims. We appreciate your consideration and welcome specific remaining concerns.
Clarification Regarding AI Usage
Dear Reviewer,
We sincerely thank you for your careful assessment of our manuscript and for your valuable feedback. We would like to respectfully clarify that, as explicitly stated in the AI Use Statement on page 11 (Lines 540–545) of our manuscript, generative AI tools were used to assist with manuscript translation and language polishing. All AI-assisted text was carefully reviewed by the authors to verify its accuracy, ensure consistency in technical terminology, and preserve the intended scientific meaning.
We fully recognize the importance of academic integrity, transparency, and scientific rigor. The authors take full responsibility for the scientific content, mathematical derivations, experimental results, and conclusions presented in the manuscript.
We sincerely appreciate your time and consideration, and thank you again for your valuable feedback.
Best regards, The Authors