- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
GeoReward uses similarity between frozen geometric-model embeddings of reference and generated frames as an inference-time reward. It supports best-of-N selection, gradient guidance, and efficient search without updating the generator. Experiments on Geometry Forcing and ReCamMaster report improvements in reconstruction fidelity and geometric consistency, with additional analyses of reward features and computational cost.
Critical strengths
The reward is simple and easy to apply to frozen generators. ReCamMaster results are particularly useful because scoring uses the available source video rather than target ground truth. Best-of-8 selection reduces GeCo error on both controlled and natural scenes.
The paper provides substantial implementation and cost analysis, including multiple critics, two seed groups, camera-following measurements, and search variants. These experiments expose both benefits and limitations rather than reporting only favorable quality metrics.
Critical weaknesses
The RealEstate10K comparison does not match the available information. Appendix A.1 states that GeoReward uses held-out ground-truth target frames, whereas the baseline generates from one context image. The fidelity gains therefore combine additional scene observations with inference-time alignment. Without a context-only reward or a baseline given the same references, Table 1 does not establish improvement under the original image-conditioned setting.
The evidence that the reward improves geometry without compromising the requested view is incomplete. Guidance increases rotational ATE from 3.66° to 4.70°, with a paired confidence interval excluding zero (Table 14). Meanwhile, the appearance-feature controls differ in backbone size, preprocessing, and pooling, so they do not isolate the contribution of geometry training. These issues leave unclear how much the reward measures geometric fidelity versus reference appearance similarity.
Questions for authors
How does GeoReward perform on RealEstate10K when the reward uses only the input context image? Alternatively, can you compare methods with access to the same reference frames?
Can you compare the geometry-trained π³ encoder with its original DINOv2 ViT-L/14 counterpart using identical preprocessing and pooling?
Can guidance improve GeCo while maintaining camera adherence, for example by varying guidance strength and reporting the resulting trade-off?
2 comments
Response to the remaining concerns
Dear Reviewer a9aX,
We sincerely thank you for your follow-up and for the time you have given to our paper. We are glad that "the matched DINOv2 comparison helps clarify the benefit of geometry training", and we will add it to the paper. We address the two remaining points below.
1. Context-only gains
- The reason is the information available to the reward. With only the context image, the reward can check each candidate only against the view the generator already conditions on, so it adds little that the generator does not already have. A single additional view changes this: one held-out frame gives significant gains on every per-video metric.
- The gain on RealEstate10K is also smaller because we chose a strong baseline. The baseline Geometry Forcing is already trained on the exact RealEstate10K dataset with geometry alignment to VGGT, so what we report on RealEstate10K is an additional gain at test time on top of a generator that has already been aligned with geometry.
- Where GeoReward needs no extra observation, namely source-video conditioned generation, the reference is the generator's own input. There, best-of-8 reduces fused GeCo by 13.2% and 16.4% on controlled standard and OOD trajectories and by 6.2% and 10.3% on natural videos (Tables 2 and 3), without any target ground truth.
2. Best-of-8 with the weaker guidance
- We acknowledge that with best-of-8 has not been tested directly. It requires 1,600 guided videos (two seed groups, 100 videos, eight candidates each), about 1,000 GPU hours, and we regret that we could not complete it within the discussion period.
- We will run with best-of-8 on both seed groups and add it to Table 14 in the final version, whatever the outcome. If it shows a camera cost, we will recommend selection alone whenever camera accuracy is the priority, and state this in the paper.
- The applicability of the method does not depend on guidance. Best-of-8 alone, the configuration behind our main results, has no detectable camera change (Table 14). Guidance is an optional addition for larger geometric gains, and it helps most when the camera trajectory is out of the training distribution, where the base generator already fails to follow the camera (Table 13). On the controlled OOD loops, guidance raises the GeCo reduction of best-of-8 from 16.4% to 20.9% (Table 2).
We are grateful for your careful engagement throughout the discussion, which has made the claims of the paper clearer and more precise. We sincerely hope that you will consider our overall contribution when making your final decision.
The matched DINOv2 comparison helps clarify the benefit of geometry training. However, the context-only gains remain small, and the weaker guidance has yet to be tested with best-of-8 to establish whether it preserves camera accuracy. These concerns still limit my confidence in the method’s applicability, so I’m keeping my score at 2.