- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents OccGSGen, a framework that generates a persistent Gaussian world from semantic occupancy, calibrated camera poses, and tracked actor motion, without reference RGB at inference. The saved world uses Gaussians to store geometry and rendering attributes, and an appearance atlas stores surface appearance independently of Gaussian primitives. A deterministic composer applies occupancy-constrained updates; Gaussian acceptance is decided by correspondence, visibility, depth/alpha, and projected support. Static surfaces are queried in world coordinates and actors in object-local coordinates, with appearance read by patch interpolation. Future read supervision trains initial appearance predictions through later atlas reads. An optional video completion module fills unsupported regions in rendered videos without modifying the saved world or continuation history. Experiments use nuScenes and Occ3D occupancy with three forward-facing cameras.
Critical strengths
- This work addresses an important and timely problem: controllable Gaussian generation for driving scenes. This is a relevant and practically significant setting, and framing the method around persistent world construction under several conditions, such as camera and ego-motion, is well motivated.
- The proposed structure-driven Gaussian acceptance rule is a solid technical contribution. Combining correspondence, visibility, depth/alpha, and projected support gives a principled way to control primitive growth, and the ablation provides useful evidence: removing the support check increases the Gaussian count by without affect FID/FVD.
- The optional video completion module is practically valuable. By filling unsupported regions, including areas outside the finite occupancy volume, it substantially extends the usable range of synthesized camera views. This improves the practical utility of the rendered outputs while aligning with the geometry of the Gaussian world.
Critical weaknesses
- The comparison in Table 2 is not well aligned with the generative setting. Most Table 2 baselines are reconstruction-oriented methods. This work is a controllable generative framework. MagicDrive3D appears to be the most direct baseline: it also outputs Gaussians and uses fewer conditions, yet it is compared in Table 1 rather than Table 2. The authors should reposition MagicDrive3D in the novel-view comparison or explicitly justify why it is excluded from Table 2.
- The occupancy condition is assumed available, but its acquisition is not discussed. Occupancy is often difficult to obtain in practice. The authors should discuss practical and simple occupancy acquisition options, such as off-the-shelf occupancy predictors or camera/LiDAR-based estimation pipelines, and clarify how such imperfect occupancy would affect the method.
- The effectiveness of the generated data is not validated. For controllability, the authors are encouraged to use the benchmark proposed in arXiv:2507.01735 and evaluate control accuracy with perception models. In addition, the paper should provide evidence that training with the synthetic data improves downstream model performance, rather than only reporting rendering/video metrics.
- Diversity of generated scenes is not evaluated. The paper reports fidelity and consistency but does not provide diversity results. The authors should add metrics or analyses on scene, appearance, and actor-layout diversity to demonstrate that the model does not merely reproduce limited modes.
Questions for authors
- How easily can the proposed framework be extended to other driving datasets such as Waymo? The authors are encouraged to briefly discuss the expected effort and, if possible, provide preliminary evidence of cross-dataset generalization.