- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
WorldState proposes a scalable implicit memory for interactive video world models built on a hybrid-attention SANA-WM backbone. It decouples memory erasure from writing, partitions history into temporally isolated recurrent states, and routes the current query to relevant states. The number of states grows logarithmically with sequence length. Evaluations on one-minute camera trajectories and RealEstate10K report improved revisit consistency, camera control, and competitive visual quality, together with scaling and component ablations.
Critical strengths
-
The paper identifies a concrete limitation of a single recurrent memory state: new observations continually compete with and overwrite older content. Temporally partitioned states with selective routing are a clean and scalable response, and the capacity-matched ablation suggests that the gain is not explained only by additional memory size.
-
The empirical evaluation is broad and internally consistent. WorldState improves both synthetic revisit metrics and ground-truth RealEstate10K evaluation, while maintaining reasonable memory and runtime. The component and state-update ablations support the main architectural choices.
Critical weaknesses
-
The strongest controlled comparison is with the SANA-WM backbone, while comparisons with other world models mix different architectures, training data, and generation procedures. The results therefore establish a strong improvement over this backbone more clearly than a general advantage over all explicit-memory approaches.
-
The scalability claim is stronger than the demonstrated horizon. The main evaluation is one minute, and logarithmically growing states still increase storage and routing work. Longer stress tests would help establish when routing becomes diffuse, whether early memories remain accessible, and how quality, latency, and memory scale together.
Questions for authors
-
Can the authors provide a controlled comparison with an explicit-memory baseline using the same backbone, training data, and generation budget?
-
How do quality, latency, and peak memory behave beyond one minute, for example at two, four, and eight minutes? How many memory states are active and effectively used at those horizons?
Overall Response to Reviewer Feedback: Addressing Key Concerns and Summarizing Main Improvements
General Response
We thank all three reviewers for their constructive feedback. We are pleased that the reviewers recognize the well-motivated problem formulation (aSNK, 4W7z, 4htR), the coherent and efficient memory design (4W7z, 4htR), and the broad evaluation with clear empirical gains (aSNK, 4W7z, 4htR).
Our Contribution
Decoupled memory editing: Independent control of erasure and writing, combined with channel-wise decay.
Scalable historical memory and context-aware routing: Multiple temporal states organize history, while query-conditioned routing dynamically adjusts their contributions.
Effective empirical performance: Improvements in revisit consistency, scene reconstruction, and camera control with modest additional overhead.
Main improvements
Other additions to the paper