- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes World4Scorer to address the supervision gap in generate-and-select planners for end-to-end autonomous driving, specifically the lack of future supervision when the scorer evaluates unexecuted trajectories. Experiments demonstrate state-of-the-art performance on NAVSIM benchmarks, along with strong generalization in closed-loop Bench2Drive evaluations and cross-domain manipulation tasks.
Critical strengths
-
Clear problem formulation and efficient method design. To address the lack of supervision for unexecuted trajectories, the paper integrates simulator outcome labels with observed future visual features. This mechanism effectively constrains the learning of latent states without incurring the computational overhead of video generation during inference, offering a computationally efficient trade-off.
-
Comprehensive experiments, ablation studies and visualization analysis. For instance, visualizing the future features for different trajectory intentions and demonstrating the specific impact of state interventions on trajectory selection intuitively and effectively validates the physical plausibility of the latent state representations.
Critical weaknesses
-
Potential reliance on simulator rules. The core supervision signals for the scorer depend on simulator-generated labels. If the simulator's physical rules or collision detection mechanisms deviate from the real world (Sim-to-Real gap), the scorer may produce misjudgments in complex, long-tail scenarios not adequately covered by the simulator.
-
Decoupling of the post-processing module from the backbone network. Inertial re-ranking serves as a non-learnable post-processing module, meaning it cannot optimize the backbone network via gradient backpropagation. If the scorer's predicted scores have minor deviations, the re-ranking stage might frequently reject high-scoring trajectories, potentially leading to sub-optimal selections.
Questions for authors
Please refer to the Weaknesses.
3 comments
Dear Reviewer QVvn,
Thank you again for your positive review. The discussion period ends on November 18 (AoE), and we have not heard back from you yet. If you have any follow-up questions, an early reply would leave us enough time to answer them before the deadline.
Following your review, the revision tests re-ranking under noisy scores (Appendix F.6), and the Conclusion now states that the logged agents behind our NAVSIM labels do not react to our plan. Could you let us know whether this addresses your concerns? If it does, we would be grateful if you could take it into account in your final rating.
Best regards, Authors
Thank you for the rebuttal. I appreciate the authors' efforts to address my concerns. The revisions have improved the completeness of the paper. Based on my overall assessment of the paper's novelty and contributions, I will maintain my rating.
Thank You for the Positive Review: Re-Ranking Changes 16% of Choices, Repairing 1,599 Consecutive Pairs and Breaking 10
Dear Reviewer QVvn,
Thank you for your valuable feedback. The revision adds a test of re-ranking under noisy scores in a new Appendix F at the end of the paper (F.6), and the Conclusion now states the limitation of non-reactive agents. The changes made for you are shown in orange.
In short:
W1. How much do the labels rely on simulator rules?Only through the ego vehicle's own motion: the scene, the other agents and the map in our outcome labels come from real driving logs, and the future target is a real camera frame. Each candidate is tracked through a recorded nuPlan scene by an LQR controller with a kinematic bicycle model, and then checked for collisions against the logged agent boxes and for drivable-area compliance against the HD map (Appendix B.1).
Because imitation makes most generated candidates safe, few of them show rare outcomes. The scene-matched bank adds labelled unsafe plans, such as collisions and drivable-area violations (Figure 4).
The remaining gap is that background agents follow their logs and do not react to our plan. Bench2Drive tests the planner in CARLA, where traffic reacts. There, World4Scorer reaches a Driving Score of 73.27 over 220 routes (Table 3), and 72.13 when its ego state comes from GNSS, IMU and speedometer estimates (Appendix F.7).
W2. Can re-ranking reject high-scoring plans when the scores are slightly off?Only when the top plan breaks continuity: candidates that continue the previous plan receive no penalty, so their learned order stands.
On the repaired pairs, re-ranking also reduces heading jitter by 34%, and among the changed selections, the distance to the logged plan drops from 1.98 to 1.61 m (Appendix E.2).
Re-ranking keeps its gain when the learned scores are noisy. In a new test (Appendix F.6), we added Gaussian noise to the scores before selection, with a standard deviation of up to twice the per-frame spread of the 64 candidate scores. Re-ranking raised EPDMS at every noise level, by +1.58 to +2.59 points, including levels at which the noise had already changed most framewise choices. Without noise, when re-ranking changes the choice, the plan it picks scores a median of 0.0066 below the top-scoring plan.
Re-ranking sits outside the network on purpose: it needs no labels and no retraining, so it works with any scorer. With DrivoR's weights and candidates fixed, it raises EPDMS from 90.66 to 92.27 (Appendix E.3).
Thank you again for your positive assessment. We hope these results address both concerns, and we would be grateful if you would consider raising your score.
Best regards,
Authors