- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
EvoWorld is a vision-centric, non-autoregressive world model that uses continuous 4D semantic Gaussian primitives for occupancy forecasting at arbitrary timestamps and open-loop motion planning. It decomposes primitive motion into ego-induced and object-level components, improving motion interpretability and displacement accuracy. Experiments on Occ3D-nuScenes and Occ3D-Waymo demonstrate improved forecasting, competitive planning, and consistent object associations, while halving the Gaussian count preserves forecasting performance with lower memory usage and inference time.
Critical strengths
The method uses continuous 4D semantic Gaussians to explicitly represent scene geometry and motion, making future scene evolution more intuitive and interpretable. The shared representation supports independent queries at arbitrary timestamps within the forecast horizon and parallel decoding, while serving both occupancy forecasting and motion planning with temporal flexibility and computational efficiency.
Critical weaknesses
-
The paper does not compare accuracy or efficiency with I²-World [1] or GenieDrive [2]. These recent methods may perform better or run faster, so leaving them out makes it hard to judge where EvoWorld stands and raises concerns about how the baselines were chosen. I would expect these comparisons to be included.
-
A world model should be able to answer the question: “What would happen if the agent took a different action?” The paper does not test this ability or discuss whether EvoWorld can accurately predict different futures under different actions.
-
I am still not clear on how EvoWorld differs from existing Gaussian-based methods, especially GaussianAD, which already predicts Gaussian displacements for future scene prediction and planning. What does the shared continuous 4D representation add beyond 3D Gaussians with time-dependent displacements? Comparing these approaches under the same setup, including a baseline that interpolates discrete displacement predictions over time, would help clarify the contribution.
[1] I²-World: Intra-Inter Tokenization for Efficient Dynamic 4D Scene Forecasting. ICCV, 2025.
[2] GenieDrive: Towards Physics-Aware Driving World Model with 4D Occupancy Guided Video Generation. CVPR, 2026.
Questions for authors
see Weakness
5 comments
Thank you for the response. However, the differences cited by the authors do not justify omitting comparisons in the main manuscript, as the occupancy tasks are essentially the same. These studies are also absent from the main manuscript’s related work section (with only I²World mentioned in the appendix). Furthermore, the main manuscript was not revised during the rebuttal period to address these omissions. This raises strong suspicions that the authors have deliberately avoided discussing and comparing against these studies.
Thank you for raising this concern. We agree that the shared occupancy task warrants a direct comparison in the main manuscript. Given the limited rebuttal period, we prioritized completing the requested experiments and provided the comparison in our rebuttal response. We understand why leaving the manuscript unchanged raised concerns. We are now revising the manuscript to include the comparison in the main results and discuss each study in Related Work. We will share the updated manuscript as soon as possible.
We thank the reviewer for highlighting the interpretability and temporal flexibility of our explicit 4D Gaussian representation. We address the requested baselines, alternative future actions, and differences from GaussianAD.
W1. Comparisons with I²-World and GenieDrive
Evaluation setting. The original protocols differ in whether current occupancy and the future ego trajectory are provided as ground truth or predicted:
Adapted baselines. We feed both models STCOcc-predicted current occupancy. We replace I²-World-STC's ground-truth future ego motion with a predicted trajectory and use GenieDrive's released motion predictor. Their forecasting weights remain unchanged.
Occ3D-nuScenes results:
End-to-end efficiency on one A100:
Both EvoWorld variants outperform the adapted baselines across all four average metrics and have lower end-to-end latency, with higher peak memory. These results support direct forecasting from a continuous 4D Gaussian world as an effective alternative to autoregressive generation from compressed scene representations.
W2. Controllable action-conditioned generation
We agree that predicting scene responses to alternative actions is valuable. EvoWorld follows the predictive forecasting setting of OccWorld, PreWorld, and SparseWorld, jointly predicting future occupancy and ego trajectories from historical observations. In EvoWorld, the ego trajectory is a prediction output, whereas I²-World and GenieDrive condition future scene generation on ego motion or driving controls. We clarify this distinction and leave action-conditioned generation for future work.
W3. Difference from GaussianAD; interpolation baseline
Two main distinctions from GaussianAD.
Controlled interpolation baseline. Each Gaussian predicts XY displacements at 1, 2, and 3s, with zero displacement at t=0 and linear interpolation between timestamps. All other components and supervision remain unchanged.
EvoWorld improves mIoU and IoU at every evaluated horizon. The improvements support the effectiveness of our continuous velocity parameterization over directly predicting and interpolating future displacements.