- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
FreeView generates synchronized multi-view driving videos from a monocular reference video and camera parameters. It builds on an internal pretrained multi-view video diffusion model and introduces a reference-as-view design: clean reference tokens are processed using shared per-view self-attention, while target tokens access reference features through cross-view attention. A geometry-based retrieval mechanism selects historical reference observations, supplemented by relative temporal and spatial encodings. The model also incorporates camera-layout conditioning. Experiments on nuScenes and an internal driving dataset demonstrate improvements over several reconstruction and novel-view generation pipelines.
Critical strengths
- Expanding monocular driving videos into consistent surround-view observations is practically useful. Jointly generating target views and reusing pretrained attention for reference conditioning is a reasonable design that avoids introducing a separate reference encoder.
Critical weaknesses
-
The comparison does not sufficiently establish an advantage over existing joint multi-view generators. Much of the evaluation concerns reconstruction or geometry-assisted novel-view pipelines, including Street Gaussians, GEN3C, NeoVerse, and Vista4D. AnyView and OpenLongTail are relevant references, but generate target views separately or through a cascade. The joint-generation baseline, Cosmos-Drive-Dreams, uses a default layout without target-pose control and is explicitly included for reference only.
Recent work provides closer precedents. Sensor2Sensor(The author mentioned it in the paper and think it is a corcurrent work, but it is CVPR2026) converts monocular observations into multi-camera outputs; CVD-STORM provides a joint multi-view driving-video architecture; and Cosmos-Transfer2.5 has camera-controlled multi-view model which explicitly generates multiple target videos from a source video and target camera trajectories, albeit in robotics. These do not all constitute interchangeable driving benchmarks, but they make a controlled comparison with an existing joint-generation architecture necessary. A particularly important baseline is the same backbone trained to keep the complete reference view clean and denoise the missing views, without FreeView’s specialized memory design. I suggest the authors should select more multi-view video generation model for comparsion. Most of them have involved similar tasks during training.
-
The internal backbone obscures the source of the improvements and limits reproducibility. The method inherits its main generation architecture from an unnamed pretrained model. Its pretraining data, training recipe, and original conditioning capabilities are insufficiently documented. It is also unclear whether competing methods receive comparable driving-domain fine-tuning. Consequently, the reported gains cannot be confidently attributed to the proposed memory modules rather than the backbone or training data. The exact temporal attention structure and the construction of the adjacency graph for new camera layouts also require clarification.
-
Ablations use only four evaluation scenes at reduced resolution, with 1,000–2,000 training steps and no reported variability. In Table 4, adding the complete retrieval/encoding design raises PSNR from 12.69 to 12.94, but reduces SSIM from 0.340 to 0.337 and only slightly improves LPIPS from 0.594 to 0.592. Retrieval alone worsens PSNR and SSIM. In Table 7, shared reference self-attention improves PSNR by only 0.02 over independent reference self-attention. These results provide limited evidence for robust component-level gains, and the ablations do not directly measure the claimed improvements in cross-view consistency.
-
Flexible-view generation is insufficiently validated. Quantitative experiments primarily evaluate standard dataset camera rigs. Figure 1 offers qualitative cross-layout examples, but does not establish reliable generation at arbitrary unseen camera positions or orientations. Camera-pose conditioning alone is insufficient evidence of continuous viewpoint generalization. Evaluation at held-out intermediate angles—for example, between front-right and back-right—would better distinguish geometric controllability from adaptation to familiar camera layouts.
-
No video result is provided.
Questions for authors
Please refer to the weakness section and particularly answer the following questions:
-
What is the internal pretrained model, what data was it pretrained on, and which capabilities already existed before FreeView? Were the evaluated baselines fine-tuned on the same driving data?
-
Can you compare against standard masked reference-view conditioning on the same backbone, using identical training data and compute? How much improvement remains after controlling for joint target generation and backbone strength?
-
Can the model accurately generate intermediate camera orientations and unseen translations or intrinsics? How is the adjacency graph defined for these layouts, and can pose adherence be measured quantitatively?
Response to Reviewer QYgz
Thank you for your detailed feedback. We address your comments below.
W1, W3 & Q2 · Same-backbone reference conditioning and expanded ablations
Thank you for this suggestion. Our no-retrieval variant provides a same-backbone joint-generation baseline: it retains reference-as-view conditioning and jointly generates the target views without retrieved memory.
We expanded the ablation and evaluation sets from 20 to 40 clips. For a fair comparison, both variants use the same backbone and evaluation settings, with the same reduced batch size in these additional ablations in 480p. Adding our retrieval method improves overall performance on both sets.
20 clips
40 clips
W2 & Q1 · Backbone pretraining and task-specific training of baselines
We use an internally trained model for its multi-view generation and camera-pose control capabilities. It was initialized from Cosmos-Predict2.5-2B and trained on our internal seven-camera driving data, without public datasets at this stage. All evaluation scenes and clips were excluded from both this stage and subsequent FreeView training.
The baselines also received task-specific training. They use different backbones and datasets. For example, AnyView [4] uses Cosmos-Predict2-2B-Video2World and trains on datasets including Waymo and Lyft, while OpenLongTail fine-tunes Wan2.1-VACE-1.3B on datasets including PandaSet and nuScenes.
W3 · Reference self-attention weight sharing in Table 7
Table 7 examines whether reference self-attention requires separate weights. Both variants use memory, and their similar performance supports weight sharing. The effectiveness of our memory design is demonstrated by the same-backbone comparisons above.
W4 & Q3 · Unseen-layout generation and joint camera-pose evaluation
We extended the comparison with AnyView [4] to the unseen Waymo target layout using the same evaluation setup. FreeView achieves higher matching success rates on both reference-to-generated (RG) and generated-to-generated (GG) pairs, improving overall GMSR@10 by 13.39 percentage points.
FreeView also achieves lower mean rotation and translation errors with both pose estimators, Pi3X [2] and VGGT-Omega [3]. Following Vista4D [1], we use reconstructed poses to evaluate camera control. We jointly input the real front-view video and the generated videos, then compare their estimated relative poses with the requested poses, without aligning each view separately.
W2 & Q3 · Temporal attention and camera adjacency
Temporal attention. In each DiT block, the reference and target views use the same self-attention weights. Within each view, tokens attend across space and time.
Camera adjacency. Following MagicDrive [5] and MagicDrive-V2 [6], we connect neighboring target views according to their left-to-right arrangement around the vehicle. We use the same rule for new camera layouts.
W5 · Video results
We have uploaded video results in the supplementary material.
[1] Vista4D: Video Reshooting with 4D Point Clouds, CVPR 2026.
[2] π³: Permutation-Equivariant Visual Geometry Learning, ICLR 2026.
[3] VGGT-Ω, CVPR 2026.
[4] AnyView: Synthesizing Any Novel View in Dynamic Scenes, ECCV 2026.
[5] MagicDrive: Street View Generation with Diverse 3D Geometry Control, ICLR 2024.
[6] MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control, ICCV 2025.