- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ReDreamer addresses appearance inconsistency when objects re-enter the camera view in causal driving video generation. It maintains a geometry-grounded object memory bank: object features are extracted from the model's own generated outputs and bound to persistent instance identities. During generation, current object projections attend to the corresponding stored records through a region-masked attention mechanism, allowing the model to retrieve the same object's visual history as its position and visibility change. To reduce foreground occlusion in dense traffic, the paper introduces a footprint representation that replaces full 3D cuboids with projected ground footprints for layout control. Training uses causal rollouts with self-generated memory and distribution matching distillation (DMD) to address exposure bias between real-image training references and generated-memory deployment. The paper also proposes a Re-entry Appearance Consistency (RAC) metric and constructs controlled re-entry cases from nuScenes. Experiments report the highest RAC among evaluated driving generators and the lowest FVD with four denoising steps.
Critical strengths
- Geometry-grounded memory is a well-motivated and effective formulation for object re-entry. Binding appearance records to persistent instance identities, rather than relying solely on geometric controls or pixel-space reference frames, directly targets a failure mode that layout-conditioned generators exhibit but do not solve.
- The footprint representation is a simple, practical contribution to controllable driving generation. Replacing full cuboids with projected ground footprints reduces mutual occlusion among control primitives. This is a simple but effective idea.
Critical weaknesses
- The evaluation resolution and metric design may overstate appearance consistency. All re-entry experiments are conducted at . At this resolution, DINOv3 features on cropped vehicle regions are likely dominated by color and coarse silhouette; fine-grained attributes are overlooked. RAC therefore may not distinguish "same coarse appearance" from "same vehicle identity".
- The Wan2.1-T2V-1.3B base model advantage is not isolated. ReDreamer is built on Wan2.1-T2V-1.3B, while several baselines are built on older or even no pretrained weights. Table 3 shows ReDreamer achieving the lowest FVD, but without a backbone-matched control. Also, the contribution of the proposed memory to overall generation quality cannot be cleanly separated from the base model's generative capacity.
- Citation placement (minor). The mention of “Causal Forcing” (e.g., L282) should carry a citation at the first mention rather than only at the sentence end.
Questions for authors
- Clarification on evaluation framework. Did the authors adopt the evaluation protocol of the driving-video benchmark associated with arXiv:2507.01735 on the nuScenes validation split? Table 8 and Table 11 appear to share scene counts and temporal windows with that line of work, but I failed to see any reference to that work. If the framework was not used, a unified comparison under that protocol would strengthen the baseline evaluation.
- Backbone contribution. Can the authors provide a backbone-controlled experiment—for example, applying the same geometry-grounded memory to a baseline backbone (e.g., the UniMLVG or MagicDrive-V2 base), or reporting a Wan2.1-T2V-1.3B variant without memory under the identical RAC protocol—to isolate the gain attributable to memory from the gain attributable to the base model?
- RAC validity at low resolution. Would RAC remain discriminative between "same object" and "different object of the same color and category" at this resolution, and does the ranking of methods change at a higher generation resolution?