- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies appearance drift when revisiting previously observed views in camera-controlled causal video generation. To address this issue, it proposes CHaRM, a training-free memory mechanism. The method stores RGB frames generated during the initial visit along with their camera poses. Upon revisiting, it either directly retrieves matching frames or reprojects nearby historical frames into the target view. The retrieved content is encoded into keys and values (KV), assigned temporal positional encodings aligned with the current generation chunk, and used alongside the existing historical KV cache during generation. Experiments show that the method improves appearance consistency upon revisiting in the evaluated scenarios.
Critical strengths
-
The research problem is practically meaningful. Maintaining appearance consistency when the camera returns to previously visited locations is an important requirement for building generative environments that support continued exploration.
-
As a training-free method applied to a frozen backbone, CHaRM achieves strong results on the reported revisitation benchmarks. However, only camera control and 3D consistency are reported for WorldScore, which is insufficient for a comprehensive assessment of generation quality.
Critical weaknesses
-
The paper offers limited novelty. The idea of using point clouds to provide geometric information and reference images to supplement appearance details has been extensively explored in prior work. For example, Spatia[1] uses point clouds to provide geometry and historical frames to provide RGB details.
-
The ablation is insufficient. First, the necessity of warping reference images is unclear. It remains uncertain how much improvement warping provides over directly using historical RGB frames, especially given that it introduces additional holes. A direct comparison between warped RGB frames and the original historical RGB frames under identical settings is needed to establish the actual benefit of this step. Second, the ablation study on temporal positions is limited. The current experiments primarily compare resetting RoPE positions to zero with aligning them to the current generation chunk, without considering alternatives such as retaining the historical frames’ original temporal positions.
[1] Spatia: Video Generation with Updatable Spatial Memory
Questions for authors
- Where is the appendix?
- Can you report results for all WorldScore metrics?