- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies persistent object state for camera-/text-controlled video world models: when the camera leaves an object and later returns, generated changes should remain consistent beyond recent video context. The authors propose a recurrent pipeline connecting (1) StateSplat online feed-forward Gaussian reconstruction with object pose/reference geometry, (2) persistent state records plus learned visual memory that separates observed vs. accepted generated evidence, and (3) time-/camera-dependent readout into a LoRA-adapted Cosmos3 generator via temporal tokens and spatial feature injection. Training jointly optimizes generation and auxiliary reconstruction objectives, including reappearance windows. Experiments on CARLA and DAVIS report improved object reappearance/localization and continuation quality over GEN3C, NeoVerse, Vista4D, Spatia, and LiveWorld, with ablations supporting learned memory and spatial conditioning. The authors conclude that reappearance improves, while motion progression and responsiveness to explicit state changes remain open challenges.
Critical strengths
-
The problem is well motivated and practically important: world models need object persistence beyond short video context.
-
The system design carefully separates geometry, explicit state, and learned memory, and distinguishes observed vs. generated evidence with admission checks.
-
Empirical gains on reappearance are large on the reported CARLA clips (detection 0.99/0.95 vs. much lower baselines in Table 1), and DAVIS continuation/identity metrics also improve.
-
The paper is unusually honest about what results do not show (identity preservation, causal memory use, faithful motion), which helps interpretation.
-
Ablations, though modest, support combining learned memory with spatial injection.
Critical weaknesses
-
Evaluation scale is too small for strong claims. CARLA uses only three shared clips; DAVIS departure-return uses five eligible cases. Gains look strong, but statistical robustness and scene diversity are limited. Broader splits and more environments are needed.
-
Metrics do not fully support the title’s “remember and evolve” claim. Detection/localization and appearance-based Identity/Continuity show better reappearance, but the paper itself notes they do not establish identity preservation or causal memory use. Return localization error remains high (0.92), and motion progression is still weak. The “evolve” part is under-demonstrated.
-
System complexity vs. isolated novelty. The pipeline stacks DA3, StateSplat, gated memory, admission, Cosmos3-LoRA, etc. Contribution is mainly the coupled object-state memory interface; sharper isolation against simpler caches would strengthen novelty. Related baselines already include GEN3C / NeoVerse / Spatia / LiveWorld / WorldDirector-style ideas.
-
False positives and residual failures. Non-target detections during absence are still 0.31; qualitative results show intermediate viewpoint/background discrepancies. These limit reliability for persistent worlds.
Questions for authors
Please see weaknesses