- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This work extends the existing CARLA-based E2E driving benchmark Bench2Drive to privildged planners. It provides various privlidge input interfaces including vecorized representation, BEV mask, BEV RGB, and language representation, and evaluates planners using these representations on the proposed benchmark. It enables direct comparison between E2E planners and privilidge planners on Bench2Drive. The results show that the GT perception inputs to privilidge planners don't bring advances compared with E2E planners in this evaluation protocol.
Critical strengths
It provides adapters that port nuPlan-style learned planners (PLUTO, Diffusion Planner) and an LLM-based planner to Bench2Drive. If released, these are a useful resource for the planning community.
Critical weaknesses
First, the motivation overlooks existing work that already evaluates privileged planners under E2E protocols. The paper is motivated by stating that privileged planners are commonly evaluated on nuPlan and are therefore hard to compare with E2E methods (line 46, 47). However, privileged planners have long been evaluated alongside E2E planners under the same protocols:
- on CARLA: rule-based planners (PDM-Lite [1]), RL-based planners (Roach [2], Think2Drive [5]), and learned planners (PlanT [3], PlanT 2.0 [4])
- on NAVSIM: the privileged PDM-Closed [6] is reported together with TransFuser(TF) and LTF [7]. Notably, the official Bench2Drive training data used here was itself collected by Think2Drive, a privileged RL planner.
Second, the claim that “ground-truth scene inputs do not inherently yield a performance advantage” (line 25) is attributed to missing visual cues (line 370), while several stronger confounders are left uncontrolled:
- training data: top baselines such as SimLingo are trained on self-collected PDM-Lite data, whereas the privileged planners tested here use the standard Bench2Drive training set with only 950 clips. Table 1 does not indicate the training data of each method.
- output representation: in Table 1, the only two methods above 65 DS (SimLingo, HiP-AD) are also the only ones with decoupled path/speed-style outputs. All other E2E baselines output temporal trajectories, waypoints, or direct control, and score 38–65 DS, the same range as the tested privileged planners. HiP-AD is trained on standard Bench2Drive training set, which makes it the clearest case. Prior CARLA work (e.g., TF++ [8]) has also argued for path-based outputs over plain trajectories. The privileged planners tested here use plain trajectory outputs without such adaptation, which may account for much of their gap.
Both factors are illustrated by PlanT 2.0 [4], a privileged learned planner. It is trained on PDM-Lite data and uses decoupled path and waypoint outputs, and it reaches 92.4 DS on Bench2Drive, above every E2E method in Table 1. Its ablation further shows that, with identical privileged inputs, replacing plain waypoints with decoupled path and waypoint outputs raises the normalized DS on the CARLA validation routes from 8.1 to 28.6. This suggests that the gap between privileged planner and the best e2e planners in Table 1 likely stems from data and output design rather than from missing visual cues.
Finally, this work introduces no new scenarios, metrics, or data. Its contribution is a set of input adapters on top of the existing Bench2Drive protocol. It is unclear what capability or insight this work enables beyond running existing planners on an existing benchmark.
[1] Sima et al. PDM-Lite: A Rule-Based Planner for CARLA Leaderboard 2.0. Technical report.
[2] Zhang et al. End-to-End Urban Driving by Imitating a Reinforcement Learning Coach. ICCV, 2021.
[3] Renz et al. PlanT: Explainable Planning Transformers via Object-Level Representations. CoRL, 2022.
[4] Gerstenecker et al. PlanT 2.0: Exposing Biases and Structural Flaws in Closed-Loop Driving. arXiv:2511.07292, 2025.
[5] Li et al. Think2Drive: Efficient Reinforcement Learning by Thinking with Latent World Model for Autonomous Driving (in CARLA-v2). ECCV, 2024.
[6] Dauner et al. Parting with Misconceptions about Learning-based Vehicle Motion Planning. CoRL, 2023.
[7] Chitta et al. TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving. IEEE TPAMI, 2023.
[8] Jaeger et al. Hidden Biases of End-to-End Driving Models. ICCV, 2023.
Questions for authors
- How do the tested privileged planners perform when trained on PDM-Lite data and/or given decoupled outputs? How does PlanT 2.0 perform within your pipeline? If the gap to the strongest E2E methods closes, the finding "ground-truth scene inputs do not inherently yield a performance advantage for the privileged planners"would not hold.
- Beyond the input adapters, what does Bench2Drive-Plan enable that the existing Bench2Drive protocol does not?