- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper looks at interactive long video generation with causal AR video models, where the user keeps sending new prompts.
The authors argue that current methods keep history mostly through the visual KV cache, so once the first prompt is replaced, the global attributes it set up (subject look, scene, style) slowly fade.
They propose CPC, a training-free add-on to LongLive with two parts. Semantic Anchor encodes the first prompt together with the current one and keeps a low-rank, down-scaled copy of the first prompt's tokens in the text condition. Adaptive Sink Regulation scales down the frame sink keys per head when the sink gets more attention than the oldest rolling block, to stop the sudden scene resets known as sink collapse.
Validation is on two evaluation sets the authors build with an LLM (InterVidProM and InterStoryBench), using VBench-Long dimensions, CLIP score, two new reset metrics and a 30-person user study against eight baselines.
The clearest result is that LongLive's reset problem mostly goes away, with small gains in subject consistency. Keeping the initial prompt alive is a reasonable idea, but both parts are close to known tricks, and the evidence for the text part is thin.
Critical strengths
-
A simple, training-free fix for a very visible failure. Adaptive Sink Regulation almost removes LongLive's scene resets (SRR goes from 32.73 to 0.31 at 60s) with no new parameters and no cache growth, and the user study agrees. This matters because resets are the most obvious failure in long interactive rollouts, and the fix is easy to drop into LongLive style systems.
-
The paper treats persistence of the text condition as its own axis, separate from visual memory, and compares with a broad and recent set of AR baselines over two horizons. This is useful because it gives a cheap, clear starting point for multi-prompt generation that others can build on.
Critical weaknesses
-
The main claim, that the initial text context has to persist, is not really backed by the numbers. In Table 3, Semantic Anchor alone barely changes VBench, makes resets slightly worse and lowers CLIP, and full CPC has lower CLIP than LongLive in all three settings. Persistence itself is only shown on one video (Fig. 2) and a 5-point t-SNE. There is no dataset-level persistence metric, direct concatenation is only shown qualitatively in the appendix, and the SVD ratio and scaling factor are never ablated. This matters because most of the measured gain comes from fixing the backbone's own sink collapse, which Rolling Forcing already avoids, and we can't tell what the SVD step adds beyond simply re-adding P1.
-
Novelty is limited, and the closest prior work isn't cited. Semantic Anchor is very close to One-Prompt-One-Story (ICLR 2025), which also concatenates an identity prompt with frame prompts, edits the token embeddings with SVD, and even reports the same kind of embedding compactness evidence as Fig. 3. SuppressEOT (ICLR 2024) also applies SVD to text embeddings. Adaptive Sink Regulation is a heuristic sink damping in the line of Deep Forcing, LoL and attention sink calibration in LLMs. Everything is tested on one backbone with single runs. Positioned against this work, the contribution looks like two known tricks combined on top of LongLive, which is the main reason for my score.
Questions for authors
- Can you report quantitative results for direct P1 + Pi concatenation, for concatenation with the 0.8 scaling but no SVD, and for sweeps over the truncation ratio and lambda? How were 60% and 0.8 chosen, and on which data? This decides whether Semantic Anchor adds anything beyond re-adding P1.