- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents OccluCast, a method for removing foreground vehicles from synchronized three-view driving videos, generating empty-street videos, and distilling them into renderable 3D Gaussian scenes. The authors construct 3,200 RGB clips and 3,200 mask clips from Waymo by pairing foreground masks from other scenes with empty regions in the current scene. The model is based on Wan2.1 VACE-14B and inserts a ViewSync branch every five Wan-DiT blocks, with same-timestamp attention across adjacent cameras and temporal attention within each view. It also uses two learnable text conditions for empty-street classifier-free guidance. For the 3D stage, background geometry is aggregated from LiDAR and processed with VDBFusion to build a background mesh, which is then used to filter supervision from generated videos. Table 1 compares OccluCast with StreetUnveiler, DriveEditor, and WanVACE, while Table 2 ablates ViewSync, empty-street CFG, and mesh-guided Gaussian distillation. Figures 4–5 and the supplementary video provide qualitative comparisons.
Critical strengths
The problem is practically relevant. The paper combines vehicle removal, multi-view and temporal consistency, and empty-street 3D scene construction in one pipeline, with a clear connection to scene editing for autonomous-driving simulation.
The method components are connected to the task constraints. ViewSync exchanges information across adjacent views and time, while mesh-guided distillation uses LiDAR background geometry to filter generated supervision. Table 2 includes ablations of the three main designs.
Under the reported evaluation protocol, OccluCast is best on all six generation and reconstruction metrics in Table 1. Table 2 shows that removing ViewSync or empty-street CFG degrades both generation and reconstruction, while removing mesh-guided distillation mainly affects reconstruction. Figures 4–5 and the supplementary video also provide qualitative comparisons.
Critical weaknesses
The evaluation does not isolate the main completion claims. Section 4.1 compares vehicle-free outputs with original videos containing vehicles, without specifying the FID/FVD evaluation regions. These scores can support overall visual quality but do not establish the quality of the filled regions. For the 3D results, Tables 1 and 2 report the same perceptual metrics and overlap-based MV Cons.; Figure 4 is qualitative. This leaves the geometric consistency of the completed background insufficiently tested.
The technical contribution appears mainly to be a task-specific combination of cross-view/temporal attention, foreground/background CFG, and LiDAR-filtered Gaussian supervision. The paper does not clearly distinguish these mechanisms from the closest video-editing and reconstruction methods. The scene-level train/test split, test-set size, and baseline adaptation details are also missing.
Questions for authors
Which reference videos and image regions are used for FID/FVD? Is there evidence specifically evaluating completion quality inside the removal masks?
What evidence beyond Figure 4 and the image/video metrics supports geometric consistency in the completed 3D regions?
What mechanism distinguishes ViewSync and the learned foreground/background guidance from the closest existing approaches, beyond adapting them to this pipeline?
Please specify the scene-level split and test-set size. How were the video baselines converted to 3D, and which reconstruction inputs and optimization settings were shared?
At inference, do u_bg and u_fg in Eqs. 15–17 use the same foreground mask? If not, how are the two spatial conditions constructed?