- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes GeoLA, a three-stage framework for improving geometric consistency in video generation by aligning compressed geometry latents with the needs of a pretrained video diffusion model. The key observation is that geometry latents with better reconstruction fidelity are not necessarily easier for a video generator to use; in the authors’ analysis, reconstruction-oriented compression can produce weaker geometric control and slower convergence in joint video–geometry modeling. GeoLA therefore trains a lightweight geometry adapter directly with the video flow-matching objective so that the compressed latent retains the geometric information most useful for denoising. The aligned adapter is then frozen and used for joint video–geometry flow matching, after which the joint distribution is distilled into a few-step generator for efficient inference. The paper also introduces GeoVid-80K, a curated dataset of 84,877 videos with geometry and motion annotations. Experiments on both text-to-video and image-to-video generation show improved 3D reconstruction and epipolar consistency while maintaining competitive visual quality, and controlled ablations indicate benefits from the proposed alignment objective, joint geometry–video modeling, and joint distribution distillation.
Critical strengths
-
A well-motivated geometry-latent alignment objective. The paper identifies an important mismatch between reconstruction-oriented geometry compression and the needs of a pretrained video generator: higher geometry reconstruction fidelity does not necessarily lead to better geometric control or faster joint video–geometry training. GeoLA addresses this by directly optimizing the geometry adapter using the video flow-matching objective, allowing the downstream generator itself to determine which geometric information should be retained. I find this formulation intuitive and practically meaningful.
-
A complete and empirically supported pipeline. The paper evaluates all three stages—geometry alignment, joint video–geometry modeling, and joint distribution distillation—with dedicated ablations. In particular, the controlled comparisons in Tables 4–6 provide evidence that the proposed alignment objective, joint modeling, and geometry-aware distillation each contribute to improved 3D consistency. The resulting model also achieves strong geometric metrics with only five inference steps, making the overall system practically compelling.
Critical weaknesses
-
The headline comparisons are not fully apples-to-apples. The main T2V and I2V tables compare GeoLA against released checkpoints from different methods, while GeoLA uses Wan2.1-1.3B, DepthAnything3 geometry features, and an additional Wan2.1-14B teacher for distillation. The compared systems therefore differ in backbone, model scale, training data, geometry representation, training budget, and inference pipeline. As a result, Tables 2–3 demonstrate that the complete GeoLA system is strong, but they do not cleanly isolate the advantage of the proposed geometry-latent alignment itself. The controlled ablations in Tables 4–6 partially address this issue, but only for selected baselines and components.
-
The behavior of the distilled model on genuinely dynamic scenes is insufficiently characterized. GeoVid-80K includes both static-scene camera motion and dynamic subject/object motion, but many qualitative examples emphasize static environments with strong camera movement. The current 3D consistency metrics therefore do not make it clear whether the distilled model preserves strong geometry while also maintaining complex object/human dynamics, or whether some of the gains are dominated by easier static-scene camera-motion cases. This is particularly important because prior work such as VideoGPA shows that enforcing 3D consistency can also benefit dynamic scenes.
Questions for authors
-
Could the authors provide a more apples-to-apples comparison with strong baselines? Ideally, I would like to see at least one strong baseline reimplemented with the same Wan backbone, the same DepthAnything3 geometry encoder, the same GeoVid-80K training data, and a comparable training/distillation budget, changing only the geometry representation/compression strategy. This would make it much clearer how much of the gain comes specifically from GeoLA not from differences in backbone, data, or distillation setup.
-
How does the final distilled model perform specifically on dynamic-subject or dynamic-object scenes? VideoGPA suggests that regulating 3D consistency can also improve generation in dynamic scenes. I am therefore particularly interested in the behavior of GeoLA after joint distribution distillation on such cases. Could the authors report results separately for static-subject/camera-motion scenes and genuinely dynamic scenes, or provide additional quantitative and qualitative examples involving human/object motion and interactions? This would help establish that the improved 3D consistency is preserved without sacrificing dynamic scene generation.
I am happy to say it's above borderline paper due to its solid engineering and novel idea. I am more than happy to raise the score if my concerns can be resolve during the rebuttal.
5 comments
Dear Reviewer YvxA,
Thank you once again for your valuable comments and suggestions. We hope that our responses have effectively addressed your concerns and provided sufficient clarification on the points you raised. We would sincerely welcome any remaining questions or additional suggestions, as your insights would be extremely helpful in further refining and strengthening our paper.
As the rebuttal period is approaching its end, we would greatly appreciate any further feedback you may have. Thank you again for your time and thoughtful consideration.
Thank you for your response. Great work! It would be great if you can benchmark on different VideoGPA backbones. GeoVideo has very bad reward hacking problems.it van only generate static, noise, yet large motion scenes. As far as I know it only released a very bad version on static scene. VideoGPA has ckpt on WAN and Cogvideo. It would be very helpful and informative to the community if you can benchmarking on both Cogvideo and Wan backbone.
1. Apples-to-apples comparisons
Thanks for the constructive feedback. We would like to clarify that all methods in Table 4 (DreamWorld, GeometryVAE, Gen3R, and Ours) use exactly the same experimental settings as Ours in Table 3, including the Wan2.1-1.3B architecture, training data, geometry encoder, and training budget, with the only difference being that distillation is not applied in Table 4 (as already clarified in the appendix of our submitted manuscript). This controlled comparison demonstrates that our performance gains primarily stem from our proposed geometry representation and compression strategy, rather than differences in experimental settings.
2. More Evaluation on Static and Dynamic Scenes
2.1. Qualitative Results
Thank you for this valuable suggestion. Our method preserves 3D consistency without sacrificing dynamic scene generation, as demonstrated by four experimental settings: (1) static scenes with standard camera motion, (2) static scenes with large camera motion, (3) dynamic scenes with standard camera motion, and (4) dynamic scenes with large camera motion.
Table (1). Static Scenes with Standard Camera Motion
Table (2). Static Scenes with Large Camera Movements
Table (3). Dynamic Scenes with Standard Motion
Table (4). Dynamic Scenes with Large Motion
Across all four settings, the better reconstruction quality and lower epipolar error demonstrate that GeoLA-T2V maintains superior 3D geometric consistency in both static and dynamic scenes, even under large camera and object motions. Moreover, the higher subject consistency across all settings and improved background consistency in dynamic scenes further indicate that our method preserves high visual quality under challenging motion conditions.
2.2. Quantitative Results
Thank you for the suggestion. We have added qualitative examples involving human and object motions and interactions, with the new video results included in the ZIP archive of the Supplementary Material. Unlike static scenes, these examples involve changing subject poses and spatial relationships between objects over time. The generated videos illustrate that our method can accommodate such dynamic changes, providing further evidence that joint RGB–geometry modeling does not restrict dynamic scene generation.