- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Anamora, a framework for reference-grounded multi-shot streaming audio-video generation that aims to maintain subject identity and evolving entity states across shot transitions. The method introduces two main components: 1) Reference-Grounded Multi-Shot Streaming, which provides persistent visual reference conditioning and supports online reference updates; and 2) state-aware entity memory, which selects state-compatible historical observations and allocates a fixed memory budget across entities. A dedicated agent manages reference bindings, desired states, and entity participation. The framework is built upon MiniMax-H3 Ref2AV and trained using teacher-forced adaptation and self-forced distillation. Experiments report competitive audiovisual quality and improved cross-shot consistency. The ablation experiments demonstrate the contributions of reference features and historical memory.
Critical strengths
- Clear problem definition and motivation. The paper addresses a challenging problem in streaming audiovisual generation: maintaining subject identity and state consistency across multiple shots. I particularly appreciate the distinction between reference-grounded identity preservation and the persistence of states resulting from previous interactions, which is not sufficiently addressed by conventional reference conditioning.
- The design for the state-aware entity memory is interesting. The separation between static identity references and dynamically generated observations is intuitive and well motivated. The proposed state-conditioned selection mechanism explicitly filters conflicting historical evidence, while the budget-constrained router reserves memory for temporarily inactive entities. This is a reasonable design for supporting cross-shot continuity under limited memory capacity.
- The ablations cover major design choices. Removing reference-derived memory features or historical entity memory reduces cross-shot subject consistency, and state-aware selection also improves subject consistency over state-agnostic selection, suggesting that the memory design contributes to the observed performance gains.
Critical weaknesses
- Missing evaluation of state consistency (Secs. 4.3–4.5). My main concern is that the evaluation relies on appearance similarity rather than directly measuring state correctness. I would like to see explicit state-change and reappearance experiments to validate the central claim.
- Limited long-horizon and efficiency analysis (Secs. 4.1–4.4). I would like to see how performance scales with sequence length, entity count, and memory budget. The reported 6.22 FPS and 4.32-second first-block latency also raise concerns about real-time applicability.
- There is no demo video. I always find it kinda disappointing when a video- or audio-related paper lacks a good demo.
Questions for authors
Please see Critical Weaknesses, W1 as Q1, W2 as Q2, W3 as Q3
Q4. For almost every figure: 1) the font size is too small. 2) All arrows have weirdly shaped heads. Did the authors use AI (computer use) to draw the figures? It's hard to believe humans drew such careless elements in the figure without noticing.