- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents IDOL, an end-to-end driving planner that uses transitions between predicted future BEV states to refine trajectory planning. For each trajectory anchor, a BEV world model predicts candidate-conditioned future states. An MLP-based inverse dynamics module encodes adjacent states into spatial and global transition features, which update the planning queries through cross-attention and modulation. The updated queries support another round of future reasoning before trajectory decoding and selection. An auxiliary objective supervises motion corrections relative to the expert trajectory. Experiments cover NAVSIM v1, NAVSIM v2, and Bench2Drive, with particularly strong results on the challenging navhard evaluation.
Critical strengths
-
Strong performance on challenging driving scenarios, supported by evaluation across benchmarks. The most compelling result is the two-stage NAVSIM v2 navhard evaluation, where IDOL achieves 38.0 EPDMS compared with 27.9 for WoTE. The paper also reports improvements on Bench2Drive, reaching a Driving Score of 63.22 and a success rate of 34.09%, compared with 61.71 and 31.36% for WoTE. These results are consequential to my recommendation: they indicate that the approach is useful under difficult evaluation conditions and in interactive closed-loop simulation.
-
The component studies provide evidence for the proposed transition representation. I appreciate the parameter-matched comparisons in Table 12. IDOL reaches 90.0 PDMS, compared with 88.9 for future-state features with a matched MLP and 89.1 for latent differences with a matched MLP. Since the remaining components and training settings are held fixed, these results support jointly encoding ordered state pairs. The branch and refinement ablations provide further supporting evidence. The reported inference speed of 17.65 FPS on a single RTX 3090 also suggests that the additional reasoning has a manageable computational cost.
Critical weaknesses
I do not find a weakness that warrants rejection. I have two remaining concerns that would improve the interpretation of the results:
- The inverse dynamics interpretation could be better established. The module produces latent transition features, while its explicit motion supervision predicts the difference between expert and anchor trajectories. This is a reasonable way to learn planning-relevant corrections, but it does not directly demonstrate recovery of the motion responsible for the predicted state transition. An ablation of the motion-correction loss or a direct evaluation of the encoded motion information would help clarify this interpretation. This concern does not undermine the demonstrated planning benefit.
- The strongest benchmark improvement would benefit from corresponding component analysis. Most component ablations are conducted on navtest, whereas the largest improvement appears in the two-stage navhard setting, which uses the camera-based IDOL-LTF variant. Repeating the main ablations under that configuration would help explain which components account for the improvement in difficult scenarios. I view this as a gap in attribution rather than a reason to discount the reported result.
Questions for authors
- How much does the motion-correction loss contribute when the rest of the architecture and training setup are unchanged? Do the learned features recover motion information beyond what is already encouraged by the trajectory-planning losses?
- Could the authors clarify the checkpoint and input configuration used for each navhard evaluation and provide the main component ablations under the same IDOL-LTF setup? In particular, how much do transition encoding and the additional query-refinement round contribute to the two-stage result?
3 comments
Thank you for the additional analyses. The correction-loss ablation and motion probes help clarify what the transition features encode. The navhard ablations are particularly useful: the drop from 38.0 to 29.5 without IDM supports its contribution in the challenging setting, while the smaller drop without refinement clarifies the relative roles of the two components.
These results largely address my remaining questions. They strengthen the evidence for useful motion-aware representations, although I would still distinguish this from demonstrating inverse dynamics in the conventional sense. This distinction does not change my positive assessment of the planning results.
Please incorporate these analyses and the evaluation configuration into the manuscript. Please also reconcile the stage-wise EPDMS values of 76.2/48.8 in the response to WSWz with the 38.0 result in the ablation table, so the reporting is unambiguous.
I remain supportive of acceptance and maintain my rating of 4 (clear acceptance).
Thanks for the feedback
We sincerely appreciate Reviewer pfa5’s positive assessment, continued support, and constructive feedback. We will incorporate the additional analyses and evaluation details into the revised manuscript and explicitly distinguish the stage-wise EPDMS scores (76.2/48.8) from the final two-stage aggregated score (38.0) to ensure clear and consistent reporting.
Thanks and response to Reviewer pfa5
We thank the reviewer for the insightful assessment and constructive suggestions. We address the remaining concerns below with additional motion-encoding analysis, controlled ablations, and clarification of the IDOL-LTF evaluation protocol.
Q1. How much does the motion-correction loss contribute, and do the learned features encode motion information beyond trajectory-planning supervision?
Correction-loss ablation. We evaluate the contribution of the motion-correction loss while keeping the remaining architecture and training configuration unchanged.
Removing L_corr reduces PDMS from 90.0 to 89.7, confirming that motion-correction supervision provides an additional benefit beyond the trajectory-planning objectives.
Motion-information analysis. To examine whether IDM encodes motion information beyond expert-relative corrections, we freeze the planner and train linear probes to recover the conditioning anchor's speed and heading rate. Results are evaluated on anchor identities held out from probe fitting.
The global IDM feature achieves the strongest linear recovery, indicating that it encodes accessible candidate-motion information rather than merely expert-relative corrections. Furthermore, retaining IDM updates reduces predicted-trajectory speed and heading-rate MAE by 11.38% and 15.80%, respectively, compared with bypassing these updates in the frozen planner. Together, these results support the motion-encoding capability and planning benefit of IDM, while L_corr further aligns the learned representation with actionable trajectory refinement.
Q2. What checkpoint and input configuration are used for navhard evaluation, and how do IDM and closed-loop refinement contribute under the same IDOL-LTF setup?
Evaluation configuration. The reported IDOL-LTF navhard result adopts a unified checkpoint for both evaluation stages. Inputs comprise the current front-left, front, and front-right camera images and ego status. The LTF configuration is enabled: the learned latent tensor stored in the checkpoint replaces LiDAR input. We will provide the checkpoint checksum and evaluation configuration for reproducibility.
IDOL-LTF component ablations. We further evaluate the contributions of IDM and closed-loop refinement under the same NAVSIM v2 navhard two-stage protocol. All 5,912 scenarios (450 in Stage 1 and 5,462 in Stage 2) are evaluated successfully.
Removing closed-loop refinement reduces EPDMS from 38.0 to 37.2 (-0.8), while removing IDM results in a substantially larger drop to 29.5 (-8.5). These results demonstrate that both components contribute to performance under the challenging navhard protocol, with IDM playing a particularly important role in maintaining robust planning performance. This further supports the effectiveness of transition-aware planning and iterative refinement in the camera-based IDOL-LTF configuration.
We sincerely thank the reviewer again for the constructive feedback and valuable suggestions. We will promptly incorporate the additional experiments, analyses, and clarifications into the revised manuscript to further strengthen the paper.