- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents FPD-Drive, an end-to-end autonomous driving planner that distills privileged future information into a visual policy. The method uses a teacher with access to recorded future camera observations to generate multiple high-quality trajectory targets, which are filtered by planning metrics and assigned to different student proposals. This Future-Privileged Multi-Target Distillation extends supervision beyond the single human trajectory available in each driving log. The paper further introduces Safety-Aware Score Correction to explicitly penalize highly ranked unsafe candidates relative to nearby safe alternatives and raise underestimated safety scores for safe candidates. FPD-Drive achieves strong results on NAVSIM v1 and v2, while its zero-shot HUGSIM evaluation demonstrates generalization to closed-loop settings.
Critical strengths
-
The use of recorded future camera observations to improve a privileged teacher is well motivated. Prior work such as Hydra-MDP has explored multi-target distillation from human and rule-based teachers. FPD-Drive extends this direction by conditioning its teacher on future visual observations to construct scene-adaptive alternatives, while retaining a student that only uses current observations at deployment.
-
The empirical performance is strong. FPD-Drive and FPD-Drive-Pro obtain 94.9/95.5 on NAVSIM v1 and 55.9/58.1 on NAVSIM v2, respectively. The zero-shot HUGSIM results are also encouraging, with an average HD-Score of 45.1 and route completion of 55.3. The paper includes useful component and design ablations, and the deployed student has no dependence on future observations or teacher inference.
Critical weaknesses
-
The related-work discussion of multi-target distillation could be strengthened. Hydra-MDP [1] is cited in the context of metric-based supervision, but it is also relevant as prior work that distills multiple targets from human and rule-based teachers. A more explicit discussion would help distinguish FPD-Drive's contributions, such as the future-conditioned teacher model, from prior literature.
-
There is a potential issue in using recorded future observations to generate alternative trajectories. Those observations reflect how the scene evolved under the recorded human action, whereas some distilled alternatives may induce different reactions from other agents. The PDMS-based filtering mitigates this issue but does not fully model interactive counterfactual futures. It would be helpful to analyze when future-conditioned targets become inconsistent with the alternative ego behavior.
[1] Li Z, Li K, Wang S, et al. Hydra-mdp: End-to-end multimodal planning with multi-target hydra-distillation[J]. arXiv preprint arXiv:2406.06978, 2024.
Questions for authors
I don't have other questions. Please refer to the Critical Weaknesses section.
2 comments
Thanks for the reply. My concerns have been addressed and I will keep my score.
Reply to Reviewer C1g8
We thank the reviewer for the positive assessment and constructive feedback.
W1 - Relation to Hydra-MDP and Prior Multi-Target Distillation: we will expand the distillation paragraph in Related Work to explicitly acknowledge Hydra-MDP's contributions to multi-teacher, multi-target supervision from human and rule-based teachers. We will clarify how FPD-Drive builds on this direction through a future-privileged teacher that generates scene-adaptive trajectory targets, while the deployed student uses only current observations. We will also consistently distinguish multi-metric supervision, multi-trajectory supervision, and multi-teacher distillation to make the relationship to prior work clearer.
W2 - Consistency of Future-Privileged Targets with Alternative Ego Behaviors: we acknowledge this limitation of NAVSIM v1 navtest, where surrounding agents replay their recorded trajectories without reacting to alternative ego actions. To assess performance beyond this limitation, we also evaluate on NAVSIM v2 navhard, whose Stage 2 uses synthetic follow-up scenes and whose evaluation incorporates reactive traffic agents that respond to ego behavior. As reported in Table 2, FPD-Drive and FPD-Drive-Pro achieve the highest score among the compared methods. Furthermore, our zero-shot HUGSIM closed-loop evaluation achieves the best average HD-Score and route completion among the compared methods (Table 3). These results provide empirical evidence that the distilled policy remains effective under reactive traffic and closed-loop evaluation. We have added a corresponding discussion to the Limitations section, acknowledging these evaluation limitations and the need for further real-world validation.
Following the reviewers' suggestions, we have revised the Limitations section in the appendix and added a new More Discussion section, with changes highlighted in blue.