- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GEAR, a Geometry-Enabled Attention Routing framework for long-horizon camera-controlled video generation. Experiments demonstrate state-of-the-art visual quality, precise camera control, and revisit consistency, enabling minute-long video generation along challenging user-specified camera trajectories.
Critical strengths
-
I like GEAR’s idea of decoupling visual memory from geometric addressing. I believe this insight contributes somewhat to the community.
-
Extensive experiments demonstrate that GEAR achieves state-of-the-art visual quality.
Critical weaknesses
-
The paper claims that GEAR avoids persistent 3D memory. However, the model still constructs local meshes from per-frame depth estimates and camera poses, while continuously maintaining a global Invisible Octree and a global visible mesh. Their errors may still accumulate over time and affect subsequent generations. Could the authors clarify how GEAR differs from explicit 3D-memory approaches in this respect? Furthermore, I recommend authors provide some experiments to verify the accumulation errors between two variants. Among them, one variant is the GEAR using per-frame geometry for memory addressing. Another variant is that GEAR explicitly fuses historical observations into a persistent global 3D representation and uses its reprojection as the generation condition.
-
In table.1, the long-horizon experiments only are conducted in 50 scenes from the WorldScore Static set, which are insufficient to evaluate each method's performance.
Questions for authors
Please see the critical weaknesses.
We sincerely thank the reviewer for the positive and encouraging feedback. We appreciate the recognition of our core insight and experimental results. We provide detailed responses to each of the reviewer’s comments below.
Q1: Clarification on Persistent 3D Memory and Error Accumulation.
We thank the reviewer for this insightful observation. We clarify that GEAR does maintain persistent geometric structures, including an Invisible Octree and an auxiliary global visible mesh, but these structures serve only as visibility proxies rather than appearance-bearing 3D memories. They do not store visual features or provide rendered appearance conditions for generation.
(1) Geometric Representation and Error Propagation. Importantly, GEAR constructs history-to-target correspondences exclusively from independent per-frame local geometry, rather than from a globally fused mesh (Sec.3.2 and Page.Method). This design avoids consolidating cross-view geometric inconsistencies into persistent artifacts that would otherwise propagate through reprojected appearance conditions. We have added a supplementary visualization (
supp/review-RiBP/local_correspondence.mp4and our webpage) illustrating how the history-to-target patch correspondence cache is constructed from local historical geometry.While inaccuracies in per-frame geometry may introduce erroneous correspondence candidates, errors in the global visibility proxies affect only correspondence filtering. Neither source of error directly corrupts the underlying visual memory, as visual content remains stored in independent frame latents. Moreover, GCA adaptively aggregates visual evidence from multiple historical observations, mitigating the impact of erroneous correspondences when valid alternatives remain available, as demonstrated by our correspondence-perturbation ablation (Fig. 11 and Table 2).
(2) Warped-conditioning Variant. We additionally trained a warped-conditioning variant of GEAR, following the global 3D fusion and reprojection pipeline of ViewCrafter [1], under matched training settings. As shown in the updated supplementary video (
supp/review-RiBP/warp_vs_gca.mp4) and our updated webpage, cross-view geometric inconsistencies introduce persistent 3D floaters after global fusion. These artifacts are subsequently reprojected as noisy pixel-aligned conditions and degrade generation quality. In contrast, GEAR uses the same per-frame geometric inputs and independently retrieves historical features through correspondence attention, avoiding the direct propagation of fused geometric artifacts into appearance conditioning.We also visualize GEAR's global Invisible Octree and visible mesh to clarify their roles as coarse visibility proxies for identifying unobserved regions, which are subsequently updated using newly generated frames, rather than as appearance-bearing memory representations.
Reference:
[1] ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis
Q2: Extended Evaluation on WorldScore-Static.
We appreciate the reviewer's concern regarding evaluation scale. We have expanded the WorldScore-Static evaluation to 100 randomly sampled scenes with closed-loop camera trajectories, and updated the quantitative results in our paper and added more qualitative comparisons to our project page. GEAR consistently achieves the best content alignment, photometric consistency, style consistency, and revisit performance.