- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
MemActive investigates why a frozen streaming video generator may fail to use relevant historical memory even when it is available. Its Semantic Structured Memory stores character- and scene-specific KV states from their first occurrence. Route-Specific Query RoPE then compresses query–memory temporal offsets according to text-description compatibility, while retaining native positional relations for local attention. Both routes share a softmax normalization. The method requires no additional generator training. Evaluation covers hard-cut and smooth-transition prompt sequences, controlled positional-remapping experiments, activation ablations, comparisons with additive attention bias, a blinded human study, and transfer to four additional backbones.
Critical strengths
-
The paper distinguishes memory availability from memory utilization and tests this distinction directly. The fixed-memory experiment across 100 cases changes the query–memory positional mapping while holding the supplied memory and random seed fixed. The SSM-only versus full-method comparison further supports the importance of activation: hard-cut inter-clip consistency increases from 79.24 to 85.99. The paper also correctly acknowledges that shared normalization can change local attention mass despite leaving local logits unchanged.
-
The empirical validation is comparatively broad for a training-free intervention. The evaluation includes two 100-sequence suites, each with twelve five-second clips, multiple inference-time baselines, a blinded study with 30 participants, and additional backbone tests. The comparison against additive attention bias is a useful control. Together, these results support practical usefulness beyond a single qualitative example or checkpoint.
Critical weaknesses
-
The principal entity-recall metric has important validity gaps for the claimed task. Appendix E.2 groups clips using character labels from the prompts, associates detected person crops using DINO similarity, and evaluates consistency using DINO features. This procedure does not independently verify that a detected person corresponds to the requested named entity, so visually consistent but incorrectly bound characters may escape detection. More seriously, when no person is detected, the metric falls back to the full frame rather than explicitly penalizing missing character evidence. A recurring background can therefore produce high similarity even when the requested person is absent. Only the middle frame of each clip is sampled, which also leaves within-clip disappearance or identity changes unmeasured. These issues do not prove that the reported improvements are artifacts, but they mean the headline inter-clip score is insufficient to establish reliable entity recall. The blinded human study is valuable supporting evidence, yet it does not separately quantify missing entities, identity swaps, or prompt-to-entity binding errors.
-
The evidence does not sufficiently distinguish useful interactive memory from stronger preservation of a fixed appearance anchor. SSM stores the first occurrence of each entity and never updates it; CLIP description similarity controls activation of this fixed state. The evaluation does not explicitly separate stable identity from attributes that the current prompt requires to change. Moreover, the paper’s own ablations show consequential trade-offs: in the hard-cut setting, adding the full method to the reset-controlled baseline increases inter-clip consistency from 78.67 to 85.99, but Dynamic Degree decreases from 43.92 to 30.75 and text alignment from 9.14 to 8.84 (Table 3). These changes do not establish that reduced dynamics are necessarily undesirable, but require task-specific evidence that requested actions and state changes are preserved. Cut accuracy also decreases from 100.00 for the reset-only baseline to 98.13 for the full method, demonstrating that improved cut accuracy over native baselines cannot be assigned to memory activation alone. The missing discussion of EM-Vid [4], which already combines training-free entity-indexed memory, structured scripts, and selective appearance control, further leaves the novelty and practical benefit of the proposed combination incompletely established.
-
Cite and discuss [1–3], covering complementary approaches to local/global memory, adaptive multi-shot conditioning, and long-horizon consistency. More directly, EM-Vid [4], publicly available since May 2026, should be included because it also uses a training-free entity-indexed memory and structured multi-shot scripts, while explicitly addressing selective appearance preservation. Its latent-patch representation differs from the proposed KV-state memory, and it does not establish that RSQ-RoPE has already been proposed. Nevertheless, this overlap makes a precise component-level comparison necessary: what is new in entity organization, what is new in activation, and what evidence demonstrates improved controllability?
The fixed-memory intervention and training-free implementation are interesting. However, the central recall metric does not adequately establish entity presence and correct identity binding, and the evaluation does not resolve preservation versus intended change. Together with incomplete positioning against closely related entity-memory work, these concerns prevent me from concluding that the reported consistency gains establish the claimed interactive-memory advantage.
References
[1] Zhaochong An, Menglin Jia, Haonan Qiu, et al. OneStory: Coherent Multi-Shot Video Generation with Adaptive Memory. CVPR, 2026.
[2] Hongjun Wang, Lin Liu, Jianguo Li, and Tao Lin. Dual-Granularity Memory for Efficient Video Generation. CVPR, 2026.
[3] Jingyu Lin, Xinyi Shang, Peng Sun, Cunjian Chen, and Zhiqiang Shen. DynaMem: Consistent Long Video Generation via Hierarchical Memory and Motion Priors. ICML, 2026.
[4] Jente Vandersanden, Matheus Gadelha, Chun-Hao P. Huang, Hyeonho Jeong, and Yulia Gryaditskaya. EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation. arXiv:2605.23610, 2026.
Questions for authors
-
How often does the inter-character metric use the full-frame fallback, separately for each method? Can you report entity-presence accuracy, identity-swap errors, and prompt-to-character binding accuracy using independently verified correspondences? Do the rankings persist with several sampled frames per clip and explicit treatment of missing entities?
-
Can you evaluate prompts that require an entity to retain identity while changing clothing, appearance, action, or scene state, reporting preservation and requested-change success separately? How does the CLIP-based compatibility rule perform on small textual changes with large visual consequences? Please distinguish this evaluation from generic text similarity or motion magnitude.
-
Please separate the contributions of boundary reset, SSM, and RSQ-RoPE under matched conditions, and provide paired uncertainty estimates. If the contribution is claimed to arise specifically from improved within-memory token matching, can a control matched for total memory attention mass support that interpretation? Otherwise, the narrower conclusion that the positional intervention improves selected consistency measures is more appropriate.
These questions address the validity and interpretation of the current results, rather than optional future capabilities.
9 comments
zRHV-W1 & Q1: Fallback, Five-Frame Scoring, and VLM Character Checks
MemActive retains the highest Inter-Character and Inter-Clip Consistency in both transition modes under five-frame scoring with missing detections penalized. Table 5 reports the original midpoint fallback counts for each method. MemActive used full-frame fallback for 4 of 1,200 hard-cut frames and 1 of 1,200 smooth-transition frames. In the stricter evaluation, we retain all pairs and assign zero character similarity at sampled positions where either clip lacks a valid person crop.
A separate VLM audit matches generated characters to named entities independently of DINO-based crop matching. MemActive ranks first or second in character presence, achieves binding rates of 90% under hard cuts and 93% under smooth transitions, and matches the lowest reported identity-swap score in both modes (Table 6). In the VLM identity-preservation evaluation, it exceeds Echo-Forcing by 5 percentage points under hard cuts and 7 under smooth transitions (Table 7). See Common Question 3 for the full results.
zRHV-W2(a): Fixed anchor and memory updating
Static first-occurrence memory achieves higher Inter-Clip Consistency and Identity Preservation than latest-occurrence replacement in both transition modes.
We compare static memory with a latest-occurrence updating policy (Table 10). Under the update policy, the KV from the middle latent frame of each new character appearance replaces the character's previously stored memory. Compared with this policy, static memory improves Inter-Clip Consistency from 82.69 to 85.99 for hard cuts and 91.22 to 91.98 for smooth transitions, while increasing Identity Preservation from 65% to 72% and 76% to 79%, respectively, with comparable Instruction Following rates in both transition modes. The fixed first-occurrence memory serves as a stable identity reference, while its influence is adaptively modulated according to the compatibility between the current and stored character descriptions.
Table 10. Static versus updated memory.
| Setting | Memory policy | Text Alignment↑ | Dynamic Degree↑ | Motion Smoothness↑ | Intra-Clip Consistency↑ | Inter-Clip Consistency↑ | Shot Cut Accuracy↑ | Identity Preservation (%)↑ | Instruction Following (%)↑ |
|---|---|---|---|---|---|---|---|---|---|
| Hard | Update | 8.80 | 25.73 | 99.40 | 94.47 | 82.69 | 95.22 | 65 | 9 |
| Hard | Static (Ours) | 8.84 | 30.75 | 99.41 | 94.40 | 85.99 | 98.13 | 72 | 9 |
| Smooth | Update | 8.80 | 16.00 | 99.34 | 95.96 | 91.22 | N/A | 76 | 8 |
| Smooth | Static (Ours) | 9.53 | 19.33 | 99.34 | 96.18 | 91.98 | N/A | 79 | 8 |
Point-by-point response to zRHV
Dear Reviewer zRHV,
Thank you for your constructive suggestions and for highlighting the distinction between memory availability and utilization, the controlled fixed-memory experiment, and the breadth of the evaluation supporting the method's practical usefulness. Below, we respond to your comments point by point. A typeset version of this response appears in Appendix L.4 of the revised paper, with tables and supporting figures.