- Rating
- 3
- Confidence
- 1
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes Memorizon, a training framework for long-horizon world models that decouples the training span from the attention context. It uses per-chunk retrieval and a shared memory bank to incorporate distant history without significantly increasing computational cost. Experiments show improved revisit consistency over sliding-window baselines and competitive results against existing world models.
Critical strengths
Simple and effective design. The proposed framework enables long-span supervision with bounded attention cost. The per-chunk retrieval and shared memory bank provide a practical solution to long-term consistency.
Solid experimental validation. The paper includes comparisons with recent world models and extensive ablations. The results support the effectiveness of retrieval and longer training spans, particularly for revisit consistency.
Critical weaknesses
Limited evaluation on real-world videos. Although the paper evaluates generation from real photographs, most training and quantitative evaluations rely on rendered scenes. It remains unclear how well the method generalizes to real-world videos.
Trade-off between consistency and visual quality. Longer training spans improve revisit consistency but can degrade generation quality. This trade-off may limit the practical benefits of the method.
Questions for authors
Q1: There appears to be a minor writing or notation issue in the abstract: "The bank is bounded by kK." Would "k × K" be clearer? Please also check the preceding sentence for readability.
Q2: Th evaluation includes real-world photographs as initial frames, but lacks experiments using real-world videos. Could the authors clarify whether the method can be trained and evaluated on real-world video data, and discuss the potential challenges?
2 comments
These clarifications address my main questions. I continue to favor weak acceptance.
Reply to Reviewer KgbX
Thank you for the review. Tables, videos and details: https://memorizon-rebuttal.pages.dev/
Q1 (abstract notation). Fixed. The abstract now reads "bounded by k x K", and the preceding sentence is split for readability.
Q2 (real-world video). Our view, with details and examples at https://memorizon-rebuttal.pages.dev/e6/:
Consistency versus quality. Table 13 attributes the quality loss to a train/test mismatch of the bank (clean at training, self-generated at inference), not to a weaker generator. We tested whether a milder bank noise (sigma <= 0.2, half of the samples clean) narrows this gap at 200 s: against a matched run of the same recipe, Revisit is 0.421 vs 0.388 and imaging quality 0.717 vs 0.749, which is within the run-to-run variation we see between two trainings, so the gap is not clearly narrowed (https://memorizon-rebuttal.pages.dev/e4/).