- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces ARMem, a framework for streaming video generation that jointly denoises video tokens and compact recurrent memory tokens within a shared diffusion transformer. It combines separate read/write LoRA adapters with historical identity reconstruction supervision to improve generation quality and long-term consistency under a bounded memory budget.
Critical strengths
-
The paper addresses the tension between long-term consistency and continued content evolution under a limited context budget through a clearly structured recurrent memory framework. Joint video–memory updates, separate read/write parameter adaptations, and identity reconstruction supervision form a coherent technical approach with potential practical value.
-
The evaluation covers both Wan and LTX backbones, short- and long-video generation, and image-conditioned generation, complemented by a user study and component ablations. This breadth suggests applicability across multiple settings. The ablations also provide evidence supporting the effectiveness of Dual-LoRA and readout supervision.
Critical weaknesses
-
The incremental novelty over prior work and the necessity of the proposed designs are not sufficiently established. The core idea of jointly denoising video and a recurrent latent state already appears in AdaState, while the motivation and formulation of Historical Readout closely resemble the subject reconstruction objective in Memento. The potential contributions therefore lie primarily in the combination of compact memory representations, asymmetric attention, cross-chunk memory gradients, and read/write LoRA adapters. However, the paper does not compare joint denoising against a separate learnable memory updater under controlled conditions, nor does it independently ablate asymmetric attention or cross-chunk gradient propagation. Although Table 4 supports the benefit of Dual-LoRA, it does not distinguish whether this benefit arises from mitigating read/write optimization conflicts or simply from additional parameter capacity. Consequently, the current evidence does not sufficiently substantiate the positioning of the approach as a new memory-modeling paradigm.
-
The experimental evidence for the performance advantage and its attribution remains limited. On the Wan long-video benchmarks, the improvements in average score over the strongest baseline are modest: 76.41 versus 75.75 at 30 seconds and 76.39 versus 76.01 at 60 seconds. The method does not consistently outperform the baselines in subject consistency, background consistency, or visual quality, and no uncertainty estimates are reported for these differences. The LTX comparison is also confounded by backbone differences: OmniForcing uses LTX-2, whereas the proposed method uses LTX-2.3, making it difficult to attribute the improvements solely to the proposed approach. Furthermore, AdaState, a particularly close baseline based on jointly denoised recurrent states, is absent from the experimental comparison. These limitations prevent a clear assessment of whether the proposed memory mechanism offers a meaningful advantage over the closest alternatives.
Questions for authors
-
Under the same backbone, training data, training budget, and a comparable memory budget, which specific design choices account for any performance gains of ARMem over AdaState?
-
Could the authors provide comparisons with matched backbones and long-video fine-tuning budgets, together with confidence intervals for the differences in the main metrics? Additionally, in Table 4, the full model achieves a 30-second Quality score of 82.14, slightly below the 82.24 obtained without memory. How do the authors explain this result, and could more targeted evaluations of long-term recall or identity retention help establish the contribution of the memory mechanism?
Reminder: Please Follow Up on Authors’ Responses
Dear Reviewer Wra1,
A friendly reminder to check the authors’ responses and the other reviewers’ comments. It would be helpful to hear your thoughts on the differing assessments and whether they affect your evaluation.
Thank you for your time and effort!
AC