- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies identity consistency in streaming video generation with changing prompts. MemID combines an event-based memory bank with two attention losses. The memory bank selects representative frames through clustering, freezes the memory of completed events, and retrieves historical KV features for subsequent generation. The two losses discourage attention overlap between different subjects and suppress competing spatial regions for the same subject. The model is initialized from a LongLive Stage 1 checkpoint and trained with DMD and the proposed losses. Experiments on 60-second multi-prompt videos report improvements in identity consistency and subject counting.
Critical strengths
- The paper addresses a relevant problem: retrieving the correct historical reference does not necessarily prevent the generator from mixing identities or duplicating subjects. The attention losses directly target these failures without requiring spatial annotations or additional optimization at inference time.
- The ablations show that both attention losses contribute to the final performance, and using them together gives the best identity scores. The method also avoids external LLM/VLM calls at inference, which is a practical advantage over IAMFlow.
Critical weaknesses
- My main concern is the limited novelty of the memory design. The memory component reorganizes existing retrieval-based memory by grouping frame-level KV features into prompt-defined events, selecting representative frames with K-Means, freezing completed events, and retrieving entries using text-video similarity. MemFlow already performs prompt-conditioned retrieval of historical KV features, while IAMFlow already uses identity-aware retrieval. The main differences therefore appear to be event-wise grouping, clustering, and freezing, which I view as incremental changes rather than a substantial new memory mechanism. The Exclusive Loss also shares its main idea with prior work. Separate-and-Enhance: Compositional Finetuning for Text-to-Image Diffusion Models (Bao et al., SIGGRAPH 2024) already uses a training-time separation loss to reduce overlap between object attention maps. MemID applies this idea to identity attention in streaming video generation, but it is unclear what the methodological advance is beyond this adaptation. The Tracking Loss is more distinctive. Table 3 shows that it is useful as a complete objective, but does not separate the effect of temporal association from that of suppressing competing spatial regions.
- The memory ablations do not identify which part of the design drives the reported gains. Table 2 replaces the entire proposed memory with a MemFlow-style memory, so the difference between 65.34 and 55.38 combines several changes, including event-wise freezing, frame selection, and the amount of history retained. Figure 8 does not resolve this ambiguity. Its fixed-capacity baselines are continuously overwritten, whereas the full method retains compressed memories from every completed event. The comparison therefore changes both the update rule and the size of the candidate history. The w/o K-Means variant partly isolates frame selection, but the contribution of event-wise freezing remains unclear. Table 2 also lacks the fourth matched condition: MemFlow-style memory with DMD-only training. It therefore shows the benefit of the proposed memory when the attention losses are present, and the benefit of the losses when the proposed memory is present, but does not separate their individual contributions from their interaction. The DMD-only variant scores below LongLive (53.02 vs. 62.45), but LongLive is not a matched baseline for this ablation. The results therefore support the full system, while the attribution of its gains to the two components remains incomplete.
Questions for authors
- In Figure 8, the full method retains compressed memories from every completed event, whereas the fixed-capacity banks are continuously overwritten. How should the observed gain be attributed between event-wise organization and the larger amount of history retained in the candidate pool?
- Table 2 reports the full model and two single-component ablations, but no matched baseline with neither proposed component. What can be concluded about the individual contributions of the memory and attention losses, rather than their interaction?
- How does the Exclusive Loss differ methodologically from the training-time separation loss in Separate-and-Enhance, aside from its application to streaming video? For the Tracking Loss, what evidence separates the effect of temporal association from that of suppressing competing spatial regions?