- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ARDrive, an adaptive retrieval-augmented generation (RAG) framework for autonomous driving. Instead of always using external knowledge, ARDrive learns when retrieval is needed through a [RAG] token.
The authors design a two-stage training pipeline. First, supervised fine-tuning (SFT) uses pseudo labels generated by comparing RAG and No-RAG outputs with an LLM-based semantic scorer. Then, reinforcement learning (GRPO) further optimizes reasoning quality while penalizing retrieval cost.
Experiments on BDD-X and DriveLM show improvements on several reasoning and prediction tasks. On BDD-X, ARDrive reduces RAG usage by 34 percentage points and average inference latency by 14% compared with Always-RAG. The authors also provide ablation studies, human evaluations, and closed-loop driving results.
Critical strengths
- A well-motivated and practical research problem.
The paper addresses an important limitation of RAG-based driving systems. External knowledge is not always helpful, and unnecessary retrieval increases latency. Learning when to retrieve is a reasonable way to balance reasoning quality and efficiency. This makes the research problem meaningful and relevant to practical driving systems.
- A clear method supported by multiple evaluations.
The two-stage training framework is clearly designed. The authors evaluate the method on multiple datasets and tasks. They also provide comparisons with simpler adaptive retrieval strategies, ablation studies, human evaluations, and closed-loop driving experiments. These results provide useful evidence for the effectiveness of the proposed approach.
Critical weaknesses
- Limited evidence that the learned gate accurately identifies retrieval needs.
The main contribution is learning when RAG is beneficial. Appendix Table 13 compares ARDrive with several adaptive retrieval baselines, which is valuable. However, these methods have different RAG activation rates. This makes it difficult to separate retrieval decision quality from retrieval frequency.
Moreover, the human evaluation in Appendix A.4.2 reports only 64.2% agreement between the learned gate and human judgments on non-neutral cases. This suggests that the gate captures some retrieval utility, but its decision quality remains limited.
- The contribution of RL to adaptive retrieval is not fully clear.
Table 5 shows that adding RL improves action and justification performance. However, RAG usage decreases only from 67.8% to 66.0%. This raises the question of whether RL mainly improves retrieval decisions or the model's general generation ability.
The additional Always-RAG + GRPO comparison in Appendix Table 7 helps address this concern. However, the contribution of improved gating decisions could be further isolated.
- The performance gains are not consistent across driving tasks.
ARDrive improves several metrics, but it does not consistently outperform Always-RAG. For example, on BDD-X, course prediction RMSE increases from 3.85 to 4.14.
The closed-loop evaluation in Appendix Table 15 provides encouraging results. However, the overall success rates remain low. These results support the potential of the method, but its practical benefits across different driving tasks are not yet fully established.
Questions for authors
-
Could the authors compare ARDrive with random or threshold-based retrieval strategies under the same RAG activation rate? This would help determine whether the gains come from better retrieval decisions rather than retrieval frequency.
-
Could the authors provide a more detailed analysis of the learned gate against human judgments? In particular, how often does it correctly avoid retrieval when external knowledge would be harmful?
-
How much of the improvement from RL comes from better retrieval decisions rather than better response generation? Could the authors further separate these two effects?
-
In the Bench2Drive evaluation, ARDrive activates RAG on only 3.806% of decision steps. How much of the closed-loop improvement can be attributed to these retrieval decisions?
5 comments
Response by Authors (2)
Weakness 2 & Question 3: The contribution of RL
Thanks for raising this important concern. We investigate the contribution of RL from three complementary aspects, i.e., overall task performance, semantic response quality, and retrieval decision quality. Our results further separate response generation and adaptive retrieval. We have added the results and corresponding analysis to Table 10 at Page 18, and Table 11 at Page 18 in the main manuscript.
(1) Overall task performance. As shown in Table 5, compared with SFT, RL improves Action B4 from 36.9 to 38.9, Justification B4 from 9.0 to 10.1, and Speed RMSE from 0.64 to 0.62. Meanwhile, the RAG activation ratio only decreases from 67.8% to 66.0%. These results demonstrate the overall benefits of RL.
(2) Semantic response quality. To further assess whether RL improves response generation independently, we evaluate SFT checkpoints and SFT+RL checkpoints on all 2,123 test samples using GPT-6.1 Sol High as the independent semantic evaluator. The results are:
| Task | SFT | SFT + RL |
|---|---|---|
| Action | 0.86 | 0.88 |
| Justification | 0.52 | 0.53 |
Both tasks show consistent semantic improvements, providing evidence that RL enhances the quality of generated responses.
(3) Retrieval decision quality. Human Gate Agreement on non-neutral cases increases from 61.7% for SFT to 64.2% for RL, indicating improved alignment with human retrieval judgments. More importantly, to isolate the contribution of the learned gate, we conduct a controlled gate-replacement experiment by fixing the Generator and replacing its Gate. We sample the SFT Gate decisions to match the same 66.0% RAG ratio. The results are:
| Setting | Action B4 ↑ | Justification B4 ↑ | Speed RMSE ↓ | Course RMSE ↓ | RAG Ratio |
|---|---|---|---|---|---|
| SFT Generator + SFT Gate | 36.2 | 8.6 | 0.63 | 4.06 | 66.0% |
| RL Generator + SFT Gate | 37.7 | 9.1 | 0.64 | 4.16 | 66.0% |
| RL Generator + RL Gate | 38.9 | 10.1 | 0.62 | 4.14 | 66.0% |
With the SFT Gate decisions and retrieval budget fixed, replacing the SFT Generator with the RL Generator improves Action B4 and Justification B4, demonstrating improved language generation. Furthermore, with the RL Generator and retrieval budget fixed, replacing the SFT Gate with the RL Gate improves all four task metrics. These controlled comparisons show that RL contributes through both improved semantic response generation and more effective retrieval decisions, with the optimized gate providing additional benefits beyond the generator update.
Weakness 3: The performance across driving tasks
Thanks for raising this concern. We would like to clarify that ARDrive has demonstrated the benefits of adaptive retrieval across different autonomous-driving tasks, from action understanding and motion prediction to closed-loop driving. Our results show that selective retrieval improves task performance while reducing unnecessary retrieval, with benefits extending beyond the BDD-X evaluation setting.
(1) Task-dependent performance and cross-task generalization. The Course RMSE degradation on BDD-X is closely related to its task formulation. Specifically, Speed and Course are jointly generated within the same reasoning round and share a single retrieval gate, despite having different retrieval preferences. Speed prediction tends to benefit from No-RAG, whereas Course prediction consistently benefits more from RAG (Appendix A.4.6). This creates conflicting retrieval preferences during joint policy optimization, causing the learned gate to suppress retrieval in some Course-sensitive scenarios. Consistent with this analysis, cases where Speed improves but Course deteriorates exhibit 6% lower RAG activation and 10% fewer turning scenarios than the opposite cases. This issue is specific to the joint prediction setting in BDD-X rather than a general limitation of ARDrive. Indeed, on DriveLM, ARDrive improves all three motion prediction metrics over Always-RAG. Furthermore, Bench2Drive demonstrates that the learned retrieval policy also generalizes to closed-loop driving evaluation.
(2) Closed-loop transfer. ARDrive is trained exclusively in the open-loop setting, without closed-loop rollouts or optimization. Therefore, its Bench2Drive results evaluate generalization to a different evaluation paradigm rather than performance after dedicated closed-loop training. As contextual references, open-loop-trained AD-MLP and TCP-ctrl report Driving Scores of 18.05 and 30.47, and Success Rates of 0% and 7.27%, respectively. ARDrive achieves a higher Driving Score of 35.795 and a Success Rate of 5.455%. ARDrive achieves the highest Driving Score among these open-loop-trained references. Moreover, ARDrive outperforms No-RAG and Always-RAG on Bench2Drive with only a 3.806% Decision-step RAG Ratio. These results demonstrate that adaptive retrieval generalizes well on closed-loop evaluation.
Response by Authors (3)
Question 2: More detailed analysis of the learned gate.
Thanks for this helpful suggestion. We further analyze the learned gate against human judgments to assess its ability to avoid unnecessary and potentially harmful retrieval. The results demonstrate that ARDrive exhibits selective retrieval behavior aligned with human assessments. Specifically, among samples where human annotators judge retrieval to be harmful, ARDrive selects No-RAG in approximately 54.1% of cases, compared with an overall No-RAG rate of 34.0%. This higher avoidance rate indicates that the learned gate preferentially suppresses potentially harmful retrieval rather than uniformly skipping retrieval across samples. We have added the results and corresponding analysis to Appendix A.4.2(1) at Page 23 in the main manuscript.
Question 4: Contribution of retrieval decisions to closed-loop evaluation.
Thanks for raising this important question. To isolate the contribution of learned retrieval decisions from retrieval frequency, we conduct an additional matched-budget Random-Gate experiment. Random-Gate uses the same trained ARDrive generator, retrieval engine, and low-level controller, replacing only the learned gate with random retrieval decisions while matching ARDrive's 3.806% decision-step RAG ratio. We have added the results and corresponding analysis to Table 20 at Page 27 in the main manuscript.
The results are:
| Method | Driving Score ↑ | Route Completion ↑ | Infraction Penalty ↑ | Success Rate ↑ | RAG Ratio |
|---|---|---|---|---|---|
| Random-Gate | 30.302 | 43.520% | 0.754 | 5.455% | 3.806% |
| ARDrive | 35.795 | 44.108% | 0.841 | 5.455% | 3.806% |
Under the same retrieval budget, ARDrive outperforms Random-Gate, improving Driving Score by 5.493, Route Completion by 0.588 percentage points, and Infraction Penalty by 0.087, while maintaining the same Success Rate. With the generator, retrieval engine, and controller fixed, these results isolate the benefit of learned retrieval allocation and demonstrate that the closed-loop gains cannot be explained by retrieval frequency alone.
Response by Authors (1)
We sincerely thank the reviewer for recognizing ARDrive's well-motivated research problem and clear method supported by multiple evaluations. We appreciate the constructive feedback and address the concerns below.
All the revisions in the main manuscript are marked in blue.Thanks for raising this important concern. We would like to clarify that ARDrive learns useful retrieval policies beyond simply adjusting retrieval frequency.
(1) Matched-budget Random-Gate comparison. We compare ARDrive with Random-Gate, which replaces the learned retrieval decisions with randomly assigned RAG/No-RAG decisions while keeping the same ARDrive model and a matched 66.0% RAG ratio. The three random seeds represent independent random retrieval assignments. The results are summarized below:
Under identical retrieval budgets, ARDrive consistently outperforms all three random assignments on Action and Justification, while achieving better Speed RMSE and comparable Course RMSE. This demonstrates that the gains come from more effective retrieval allocation rather than retrieval frequency.
We have added the results and corresponding analysis to Table 7 at Page 10 in the main manuscript.(2) Human agreement and retrieval decision quality. Beyond the aggregate agreement of 64.2%, our additional analyses provide direct evidence that the gate makes useful retrieval decisions. The matched-budget comparison in (1) shows that these learned decisions improve task performance over random assignments with the same generator and retrieval frequency. Together, these results demonstrate that the gate captures useful retrieval opportunities and delivers measurable benefits. Its practical utility is therefore supported by controlled task-performance evidence.
(3) Practical benefits over always-on retrieval. Across BDD-X and DriveLM, ARDrive demonstrates improved overall task performance with selective retrieval compared with Always-RAG. This advantage also extends to closed-loop driving. On Bench2Drive, ARDrive achieves the best driving performance while activating retrieval on only 3.806% of decision steps. These results demonstrate the benefits of selective retrieval across multiple autonomous-driving benchmarks and evaluation settings.