- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NEURO-SYMBOLIC DRIVE, which extracts reasoning from the execution traces of rule-based planners, including IDM, IDM MOBIL Planner, and PDM-Closed. It maps these traces to a unified four-slot schema covering scenes, constraints, candidate actions, and decisions, and uses them to jointly supervise reasoning and trajectory prediction in vision-language driving models. The authors evaluate different reasoning supervision formats and teacher selection strategies using Qwen3.5-4B on a dataset built from 520 nuPlan scenarios. The results show that, compared with trajectory-only supervision, planner-generated reasoning improves open-loop trajectory prediction under both three-camera and eight-camera settings.
Critical strengths
-
Motivation and supervision design. The paper addresses the potential mismatch between the language explanations generated by driving models and their actual planning behavior. Instead of generating explanations post hoc, it extracts reasoning from the execution of the rule-based planner that produces the target trajectory. This design is well motivated and provides a reasonable way to link reasoning supervision with planning behavior.
-
Consistent empirical improvements. Reasoning supervision improves trajectory prediction under both three-camera and eight-camera settings. Detailed reasoning reduces ADE@3s from 0.47 to 0.26 and from 0.54 to 0.26, respectively, while reducing MR@3s from 8.30% to 6.40% and from 10.13% to 5.99%. The multi-planner ablation also shows that combining different teacher planners achieves better overall results than using a single teacher.
Critical weaknesses
-
Insufficient validation of the core reasoning contribution and faithfulness. The paper's central claim is that planner execution traces provide faithful reasoning. However, the fact that the teacher's execution state and target trajectory come from the same planner execution does not guarantee that the model's generated reasoning remains faithful to its predicted behavior after supervised fine-tuning. The experiments mainly evaluate trajectory prediction errors and do not directly measure the consistency between generated reasoning and teacher traces in terms of scene understanding, constraint assessment, candidate filtering, and final decisions. Figure 3 also shows differences between the GT reasoning and predicted reasoning in scene classification and state descriptions. Since this example is used to illustrate the consistency between generated reasoning and the predicted trajectory, the evidence is insufficient. In addition, the main experiments compare no reasoning, concise reasoning, and detailed reasoning, but do not report an independent generic-reasoning baseline. The representative outputs for detailed reasoning are also about three times as long as those for concise reasoning and nine times as long as those for the no-reasoning version. The current experiments cannot clearly distinguish gains from the decision semantics provided by the planner from gains due to the additional training signal in longer text. Furthermore, the paper does not sufficiently validate the necessity of the four-slot schema itself through structural ablations of Scene, Constraint, Candidate, and Decision. Overall, the results support the claim that reasoning supervision can improve trajectory prediction, but they do not fully establish the independent contribution of the proposed planner-grounded reasoning in terms of faithfulness and design.
-
Limited generalization evidence and incomplete experimental validation. All main experiments use Qwen3.5-4B, with no results on other backbones, limiting the assessment of cross-model generalization. The paper also does not report means, variances, or confidence intervals across multiple random seeds, so the stability of some smaller gains remains unclear. In addition, the evaluation mainly focuses on open-loop errors between predicted trajectories and the target trajectories generated by rule-based planners. Although Section 4.4 reports the closed-loop performance of the rule-based planners, it does not evaluate the trained VLA in closed-loop driving. Therefore, the current results do not directly support claims of improved closed-loop safety or interaction capabilities. The planner-source ablation also contains results that are not fully explained: when IDM MOBIL Planner is used as the sole teacher, ADE@3s reaches 3.60 and 3.70 under the three-camera and eight-camera settings, respectively, far higher than in the other settings. The authors attribute this to the planner's limited suitability for certain scenarios, but the target trajectories used for evaluation and the comparability of results across teacher settings remain unclear. Furthermore, the paper does not clearly explain the relationship between filling in missing teacher scores and the actual teacher selection process, or how teacher selection scores relate to the training, validation, and test splits. Together, these issues limit the assessment of result stability, the effectiveness of the teacher selection strategy, and the generalization of the overall method.
Questions for authors
-
Reasoning faithfulness and supervision source: Beyond the fact that the teacher's execution state and target trajectory come from the same planner execution, have the authors evaluated the consistency between the reasoning generated by the trained model and its actual planning decisions? What are the results for the generic-reasoning baseline? Could the authors clarify whether this experiment was conducted and explain how they distinguish the contribution of planner-grounded reasoning from that of general reasoning supervision and differences in text length?
-
Generalization and driving performance: Have the authors evaluated the method with other backbones and assessed result stability across different random seeds? In addition, has the trained VLA been evaluated in closed-loop simulation? If not, to what extent can the improvements in open-loop trajectory errors support claims about actual driving decisions and safety?
-
Planner-source ablation and teacher selection: Can the unusually high errors of IDM MOBIL Planner in Table 2 be further explained? Do experiments using different teacher sources use the same target trajectories for evaluation?