- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RoXDrive performs closed-loop RL post-training of driving policies using an action-conditioned video world model. An inverse-dynamics evaluator with geometry-aware supervision filters rollouts whose visual ego motion disagrees with the conditioning actions. Experiments on nuScenes and an internal dataset report improved safety and driving scores across multiple planners within X-World.
Critical strengths
The paper tries to address a consequential problem: visually plausible world-model rollouts may violate action conditions and provide misleading policy-training signals. The experiments and filtering ablations provide useful evidence that geometry-aware supervision improves inverse dynamics and yields additional gains within the tested environment.
Critical weaknesses
- Closed-loop training and evaluation both depend on the closed-source X-World, without a demonstrated reproduction path or independent-environment validation. The results establish simulator-specific improvements, while their transferability remains uncertain.
- Inverse-dynamics-based rollout checking has close precedents, including SC3-Eval. The remaining contribution requires stronger comparisons against simple consistency filtering and clearer separation from additional expert-supervised hard-scene training. Experiment scale alone does not establish this distinction.
Questions for authors
- What access, checkpoints, and evaluation resources will be provided to enable independent reproduction of the core closed-loop results?
- How is AVFE validated on generated videos, particularly regarding false acceptance, false rejection, and retention of difficult or unsafe scenarios?
- Do the gains persist against matched-retention consistency-filtering baselines and equivalent additional expert supervision? Independent-environment results would also strengthen my assessment.
Thank you for the additional experiments and clarifications. They partially address concerns. However, several concerns remain:
The rebuttal strengthens the empirical evidence but only partially resolves my concerns. I therefore maintain my original rating.