- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the challenge of subject appearance drift across shots in long-form video generation. The proposed method is built upon a memory-conditioned autoregressive generation framework and consists of three components: First, a subject-aware data pipeline utilizes Qwen3-VL for three-stage annotation to establish a consistent list of characters. Additionally, ByteTrack is employed to select the frame where a character occupies the largest portion of the screen, serving as the target for reconstruction. Second, a dual-path decoupled memory bank uses story/character descriptions and current shot descriptions to independently condition two sets of learnable queries. These queries retrieve long-range identity evidence and short-range contextual references from a shared candidate pool, forming a memory bank of fixed capacity. Third, a subject-anchored multi-task training strategy is implemented: in addition to standard next-shot denoising, the shared DiT is tasked with reconstructing target frames using only the memory bank and character text descriptions. This forces the model to retain and retrieve critical identity cues from memory. The model is based on Wan2.2 14B and was trained on approximately 20,000 film clips. On the STbench benchmark, Memento outperforms StoryDiffusion, Mask²DiT, StoryMem, and HoloCine across three subject-consistency metrics, as well as in semantic and background consistency, while ranking second in aesthetic quality. It also achieves the best subject consistency in out-of-distribution testing on VBench.
Critical strengths
-
The research problem is precisely defined, and the motivation is clear. The authors’ argument that "consistency should be explicitly learned" is compelling.
-
The experiments cover representative methods across three paradigms and include quantitative analysis, qualitative analysis, user studies, and ablation studies.
Critical weaknesses
-
One of my concerns is that while the paper’s main argument revolves around "identity preservation," the three subject consistency metrics that are based on the cosine similarity of full-frame DINOv2 features and full-sequence ViCLIP features. Intuitively, these metrics evaluate whether shots featuring the same character "look similar" overall, rather than whether the individual is, in fact, the same person. There are no metrics specifically targeting facial or bodily identity.
-
The ablation results for the three proposed modules appear somewhat inconsistent. In Table 3, the full method that incorporates all three modules ranks only second across all three subject consistency metrics, with the "story query + recon" configuration performing best. The paper does not provide a detailed explanation for this phenomenon.
-
Regarding the comparative baselines, the paper’s baselines and literature review are mainly limited to 2025; they neither discuss nor compare against a significant number of memory-driven long-video methods that have emerged since 2026 (such as SlotMem[1], VideoMemory[2], and Context Forcing[3]). Furthermore, while the authors mention OneStory in their related work, they do not include it in their empirical comparisons.
-
The experimental section lacks essential training details, such as the number of training steps, batch size, and total training duration. Furthermore, regarding the writing style, the manuscript consistently uses the
\citetformat (e.g., "text alignment Ho et al. (2020); Peebles & Xie (2023); …") throughout; this should be changed to\citep. Additionally, I suggest adjusting the layout on page 8.
[1] SlotMem: Character-Addressable Internal Memory for Narrative Long Video Generation
[2] VideoMemory: Toward Consistent Video Generation via Memory Integration
[3] Context Forcing: Consistent Autoregressive Video Generation with Long Context
Questions for authors
Please refer to weaknesses.
5 comments
Response to Reviewer kVsw (Part 2)
Weakness 2.
Our goal is to preserve subject identity while maintaining semantic alignment and overall video quality, rather than maximize subject consistency alone. As discussed in Sec. 4.2, all ablation variants use the same fixed memory budget, and the two retrieval paths serve complementary purposes. The Story Query + Reconstruction variant allocates the entire memory budget to story-conditioned retrieval, prioritizing subject-relevant appearance evidence. Its highest scores on all three subject-consistency metrics support the intended role of story queries in retrieving subject-related memories, which align naturally with the reconstruction objective. However, without shot-conditioned retrieval, memory selection is not explicitly guided by the contextual requirements of the upcoming shot, such as scene layout and motion-related cues. These references are important for coherent next-shot generation and are specifically targeted by the shot queries.
Our full model therefore allocates two memory frames to story-conditioned retrieval and six to shot-conditioned retrieval. Compared with Story Query + Reconstruction, this allocation improves story/shot semantic consistency from 0.2571/0.2651 to 0.3063/0.2893 and background consistency from 0.9714 to 0.9805, while retaining subject-consistency scores close to those of the identity-focused variant. These results illustrate the benefit of combining identity-oriented evidence with shot-specific contextual references.
Weakness 4.
We will expand Appendix to include the omitted training details. We train Memento for 1,200 steps with a batch size of 64 on 16 NVIDIA H100 GPUs. We will add these details to Appendix and release our training and inference code to improve reproducibility.
Regarding presentation, we will revise the citation and adjust the layout of page 8 to improve readability.
Awaiting Your Thoughts on Our Rebuttal
Thank you very much for your thoughtful review and constructive comments. Your insightful feedback has greatly helped us improve the overall quality of the paper. We sincerely hope that our detailed responses have adequately addressed your concerns.
If our revisions and explanations have resolved the issues you raised, we anticipate your reconsideration of the overall assessment of our paper. Your recognition would mean a great deal to us.
If you have any further questions or suggestions, we would be more than happy to continue the discussion.
We truly appreciate the time and effort you have dedicated to reviewing our submission and our response.
Best regards,
Authors
Response to Reviewer kVsw (Part 1)
We thank the reviewer for recognizing our problem formulation and experimental coverage, and for the constructive suggestions on identity-specific evaluation, ablation analysis, recent baselines, and reproducibility.
Weakness 1 & Weakness 3.
We have expanded our quantitative evaluation by adding ArcFace-based facial identity similarity and including three additional baselines: SlotMem, VideoMemory, and Context Forcing. For each video, we select one main character and identify all shots in which this character appears alone. We crop the character's face from all valid frames in these shots and uniformly sample 20 frames from the resulting temporally ordered collection. We extract ArcFace embeddings from the sampled face crops and compute cosine similarity for every pair of distinct frames. The video's facial identity consistency score is the mean over these 190 pairs.
Bold, underline, and italics indicate the best, second-best, and third-best results, respectively. Story-level and shot-level semantic consistency are ranked separately.
ArcFace provides a face-specific identity measure that complements the original DINOv2 and ViCLIP based consistency metrics. In the updated evaluation, Memento achieves higher ArcFace similarity than StoryMem and HoloCine, alongside improvements in inter-shot, intra-shot, and inter-scene consistency. These results provide evidence of improved facial identity preservation, beyond the overall visual similarity captured by the original metrics.
The updated comparison table includes quantitative results for SlotMem, VideoMemory, and Context Forcing, extending the evaluation to the recent methods highlighted by the reviewer. We will also expand the related-work discussion to clarify their connections to and differences from Memento.
Memento achieves the highest inter-shot, intra-shot, and inter-scene consistency among the evaluated methods. It also achieves the highest ArcFace similarity (0.2807), outperforming Context Forcing (0.2618), HoloCine (0.2592), SlotMem (0.2536), StoryMem (0.2515), and VideoMemory (0.2478). These results provide consistent evidence of improvements in both overall appearance consistency and facial identity preservation. The ArcFace results are consistent with the improvements observed under the subject-consistency metrics used in our paper.
Regarding OneStory, we could not obtain publicly available official code or pretrained checkpoints and therefore could not include it in the quantitative comparison under our evaluation protocol.