- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes SymRegFlow, which utilizes noisy anchors obtained by projecting two source perspectives. Through effective region supervision and denoising prediction consistency under shared noise, it ADAPTS to pre-trained multi-view video models, achieving the generation of new perspectives without RGB supervision of the target perspective. In addition, the method introduces directional cross-view attention to reduce the interference of noise anchors on the generation of the original view.
Critical strengths
The method addresses the practical problem of lacking target perspective supervision by combining complementary geometric pseudo-supervision with consistent regularization, and the design is relatively clear. Post-training reasoning does not rely on anchor construction or geometric projection and has certain practical value. Ablation also verified the benefits of dual anchors and moderate consistency constraints.
Critical weaknesses
- The real driving video experiment lacks the target viewing Angle GT and is mainly evaluated through quality indicators such as FID/FVD and VBench, as well as the MEt3R cross-viewing Angle consistency index. These indicators can reflect authenticity and consistency, but they are not sufficient to directly verify the reconstruction accuracy under the specified camera. Especially for the MEt3R in the joint generation mode, the generated source perspective is used as a reference. Internal consistency does not mean it conforms to the real scene. The paper did not report pairing metrics such as PSNR, SSIM, and LPIPS on datasets with real reserved perspectives, so the verification of the accuracy of the new perspectives is still insufficient.
- Quantitative experiments only cover the interpolation of the midpoint of the camera ring on the seen scenes and do not verify the pose changes of the unseen scenes or more general cameras. The existing results are insufficient to support the wide applicability of the method for generating continuous perspectives.
Questions for authors
- Could supplementary experiments be conducted on driving datasets with real open views (such as WayveScenes101)? It is recommended not to use the RGB of the target camera during training, but only to use it as GT during testing. Report PSNR, SSIM and LPIPS in source-conditioned mode to distinguish the improvement of visual quality from the enhancement of the accuracy of target perspective reconstruction.
- Could the scenes that were not adapted be supplemented to verify whether the method can be generalized beyond the midpoint interpolation of the camera ring in the already seen scenes?
2 comments
Thanks for your detailed reply and your updated manuscript. My concerns have been addressed. Overall, the research topic is interesting, and the paper’s contributions are substantial, so I will maintain my score.
Response to Reviewer KQca
Thank you very much for the constructive feedback and positive rating. In the following responses, "Q" denotes questions and "W" denotes weaknesses.
Q1/W1 — Target-view reconstruction accuracy.
Can you report PSNR, SSIM, and LPIPS for source-conditioned reconstruction of real held-out camera views (e.g., WayveScenes101), using target-view RGB only for evaluation?
Answer: Thank you for this suggestion. We agree that evaluation against real held-out camera RGB using PSNR, SSIM, and LPIPS would directly assess target-view reconstruction accuracy. For nuScenes/Cosmos datasets, withholding an existing rig camera leaves almost no overlap with the observed views. The generated target view Appearance is therefore underconstrained, and plausible generated content may largely differ from the recorded ground truth, in this case, pixel-wise reconstruction metrics cannot provide a meaningful measurement.
Although ground-truth novel-view videos are unavailable for our nuScenes evaluation, we report ATE and rotational RPE in updated Table 1 to assess camera-trajectory accuracy.
WayveScenes101 offers a better camera configuration, with substantial overlap between the held-out front camera and the two forward side cameras. However, it lacks annotated lane geometry and 3D object boxes required to construct the world-scenario controls used by our current Cosmos-Transfer2.5 implementation. Applying our pipeline therefore requires additional annotation estimation or adaptation to a compatible multiview flow-matching backbone without HD-map conditioning. Due to limited rebuttal time and resources, we are still working on the experiments on the suggested WayveScenes101 dataset.
Q2/W2 — Scene and viewpoint generalization.
Does SymRegFlow generalize to scenes excluded from adaptation and camera poses beyond midpoint interpolation between neighboring rig cameras?
Answer: We add lateral camera shift results at ±1, ±2, and ±4 m in Table 2, where SymRegFlow achieves the best FVD and second-best FID among the compared methods. Revised Sec. 3.2 (Fig. 5; Table 1) also evaluates prompts from scenes disjoint from our 30 adaptation scenes under fixed world-scenario controls, demonstrating diverse appearances with multi-view consistency.
We further investigate unseen-pose generalization in the SE(2) toy model using disjoint training and test rotations (Appendix D.1), yielding two observations:
Due to limited rebuttal time and resources, we are still conducting more comprehensive pose generalization experiments on nuScenes.