- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
ReTranDrive addresses inconsistency between successive plans during repeated replanning. It augments a VLM conditioned diffusion planner with a differentiable kinematic consistency loss during imitation learning and an extended comfort reward during reinforcement learning. During reinforcement, a frozen Stage 2 model provides the reference plan from the previous observation, while updates apply only to the current prediction. Experiments on NAVSIM navtest report 94.40 PDMS and 90.94 EPDMS, with ablations comparing training stages, reward forms and reference choices.
Critical strengths
- The paper addresses a practically relevant limitation of optimizing each plan in isolation. Its consistency objective is simple and requires no additional learned module for coherence. Treating consistency as a soft objective allows it to be balanced against safety and progress.
- Table 4 provides direct evidence of improvement over the same planner using a reward based only on the current plan. EPDMS increases from 90.45 to 90.94 and EC from 65.13 to 69.80, while EP remains nearly unchanged at 93.39 versus 93.40. The full system also achieves strong overall benchmark scores.
Critical weaknesses
- Novelty is limited, and the claimed selective consistency is insufficiently demonstrated. The method adapts the existing EC metric within an established VLM diffusion planning and group relative optimization framework. EC applies fixed thresholds to kinematic differences without directly assessing whether scene changes require replanning. No targeted experiment separates necessary from unnecessary revisions. A simple temporal smoothing baseline and an isolated ablation of the Stage 2 consistency loss are also missing.
- The results do not fully establish improved coherence during continuous execution. EC is 69.8, below most methods in Table 2 despite strong aggregate scores. Although Table 5 compares reference choices, the main training objective uses a frozen Stage 2 reference rather than the deployed policy’s own previous plan. Evaluation is limited to the paper’s nonreactive NAVSIM setting, leaving benefits under repeated execution and responsive traffic interactions unverified.
Questions for authors
- Can you separately evaluate scenes requiring little plan revision and scenes requiring a timely change? Reporting reaction delay and safety outcomes would help determine whether improved consistency preserves necessary responses.
- Can you isolate the Stage 2 consistency loss while keeping the diffusion expert unchanged, and compare against simple temporal smoothing under the same architecture and training budget?
- Beyond the reference comparison in Table 5, what evidence shows that consistency with a frozen model transfers to consistency with the final policy’s own previous plans? Evaluation with responsive surrounding vehicles would further test this claim.
4 comments
Thank you for the additional experiments. I am still concerned about whether the consistency objective preserves timely responses to sudden hazards. The log-based analysis shows that the planner can revise its plans, but does not measure reaction delay during closed-loop execution. I am keeping my rating.
We sincerely thank the reviewer for the thoughtful follow-up and for taking the time to review our additional analyses.
Answer: To address the concern that the consistency objective may delay responses to sudden hazards, we add a closed-loop evaluation in HUGSIM, which captures dynamic responsiveness and real-time adaptation that the open-loop NAVSIM protocol cannot.
Evidence: HUGSIM is a closed-loop simulator built on reconstructed nuScenes, KITTI-360, Waymo and PandaSet scenes, designed for photo-realistic closed-loop evaluation with scripted and adversarial road users~\cite{zhou2025hugsim}; such actors make delayed hazard responses observable. The recorded surrounding traffic is replayed while the ego is driven by the evaluated planner, so the policy's decisions change the scene it subsequently observes. At the hard and extreme tiers, the injected road users are constant-velocity scripted vehicles and an ego-predicting adversarial planner, respectively. We evaluate the official HUGSIM benchmark of 436 scenarios (nuScenes 88, KITTI-360 113, Waymo 108, PandaSet 127), each at four difficulty tiers with identical recorded traffic. Both checkpoints are run on the same scenario files, initial states, injected-actor configurations, and replays, with one deterministic rollout per scenario, yielding 436 paired scenario-level comparisons per checkpoint; since the scenario files and injected-actor schedules are fixed before either checkpoint is run, hazards are not selected from the policy's behavior. We report HUGSIM's closed-loop metrics (NC, DAC, TTC, comfort, PDMS, RC, HD-Score) and per-scenario collision occurrence, comparing continuous metrics with paired Wilcoxon signed-rank tests and collision counts with McNemar's exact test. Reaction delay is measured from the scripted onset of the injected actor, taken from the scenario configuration, to the first step at which the planned waypoints depart from their pre-event trend, and is reported in planning steps and seconds.
Boundary: Because the recorded traffic is replayed, responsiveness to the ego comes from the injected actors; the reported latency is planner-level, and the runs are in progress, so the closed-loop values will be reported once they complete.
Revision: The HUGSIM experiment results will be reported in the revised PDF.
Reference: Hongyu Zhou, Longzhong Lin, Jiabao Wang, Yichong Lu, Dongfeng Bai, Bingbing Liu, Yue Wang, Andreas Geiger, and Yiyi Liao. HugSim: A real-time, photo-realistic and closed-loop simulator for autonomous driving. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025.
We thank the reviewer for the follow-up and for acknowledging the additional analyses.
- Answer: In closed-loop execution the transition reward improves riding comfort without a statistically detectable change in hazard response. On the 204 Medium+Hard pairs, the response rate is versus (McNemar ) and the median delay versus (Wilcoxon ; paired increase , CI upper bound ), with NC versus () (Table 12) and comfort to () (Table 13). The ego-predicting tier, in which actors react to the ego, shows the same pattern: versus response rate and delay in both cases (Table 12).
- Evidence: HUGSIM runs closed-loop with the ego driven by the evaluated planner and extra road users injected as constant-velocity (Medium, Hard) or ego-predicting adversarial (Extreme) actors, with the per-frame and transition-reward checkpoints sharing scenario files, initial states and replays. Onset is the step at which an injected actor enters of the logged ego reference path, and a response is a persistent two-step departure of the plan; per-tier values and the secondary metrics are in Tables 12–13 (App. A.5).
- Summary: Read together, the closed-loop results show that the consistency objective delivers its gain as riding comfort, with the hazard response rate, delay and collision score unchanged across tiers.
- Revision: Sec. 5.4 and App. A.5 with Tables 12–13 are added to the revised PDF.
We thank the reviewer for the careful reading and for the constructive suggestions. All changes and additions are included in the revised PDF. Below we respond to selective consistency, the isolated Stage-2 loss and smoothing baselines, and transfer to the policy's own plans.
Q1 (frames needing little revision vs. a timely change)
Answer: Frames are split by whether the log trajectory itself departs from the previous plan (Tables 6 and 7), and safety is measured separately on frames whose predecessor is unsafe (Table 8, App. A.2).
Evidence: On Stable frames (90.08%), the transition reward raises EC from 70.98 to 75.98 at EP 93.24 versus 93.23. On Revised frames (9.92%), EC moves from 12.05 to 13.64, i.e., the plan still departs on 87.9% and 86.4% of these frames, while EP rises 96.10 to 96.28, NC stays 98.90, and TTC improves 98.49 to 98.59 (Table 6). Over the 154 frames whose predecessor is unsafe under both checkpoints, safe corrections rise 35 to 64, unsafe overturns fall 27 to 20, carried-over errors fall 53 to 38, the overturn rate rises 40.3% to 54.5%, safe-overturn accuracy 56.5% to 76.2%, and EP 94.27 to 94.57 (Table 8). On the EC of 69.8 in Table 2: methods with higher EC report lower ego progress (86.0 to 88.9 versus 93.4), and Revised frames have higher mean speed (6.08 versus 5.21 m/s) and mean EP (96.10 versus 93.24) than Stable frames (Table 7), so lower EC partly reflects more frequent revision at higher speed rather than worse execution. The reward thus suppresses changes only on stable frames, preserves them where the log indicates a revision, and improves replacement safety.
Boundary: Reaction delay is undefined under the non-reactive NAVSIM protocol, where agents replay logged trajectories and each frame starts from the logged ego state in an independent rollout; the collision outcome is the NC rate, which does not degrade (98.90 on Revised frames). NAVSIM also has no hazard annotations, so the log's own revision is the criterion for a required change. The proxies are whether the plan changes when the log indicates it should, and whether NC and TTC degrade; neither degrades.
Revision: Tables 6--8 (App. A.2) are added.
Q2 (isolating the Stage-2 loss; temporal smoothing under the same budget)
Answer: The loss is ablated with the diffusion expert fixed, and three temporal-consistency baselines are compared under the same architecture and budget.
Evidence: Table 3 splits Stage 2 into IDs 2a and 2b: 2a trains the diffusion expert alone (EC 62.15, EPDMS 90.10); 2b adds only the coherence term (Ltc) with the expert unchanged (EC 65.10, EPDMS 90.35), so the loss contributes +2.95 EC on its own. Two baselines act at inference time on the per-frame checkpoint (temporal ensembling, hysteresis); the third retrains the same planner with the previous plan as an extra input. In Table 9, temporal ensembling reaches EPDMS 89.10 and EC 69.40, hysteresis 89.87 and 61.23, the history-conditioned baseline 90.35 and 65.10 with EP 92.57, the transition reward 90.94 and 69.80 with EP 93.40. Table 10 gives the sweep over α and δ: at α=0.7, temporal ensembling reaches EC 74.29, above ours, but EPDMS falls to 87.10, EP to 92.85, and Revised NC to 98.54. Temporal smoothing can therefore inflate EC alone by anchoring to the past; only the proposed objective raises EC without lowering EPDMS or progress.
Revision: Table 3 separates IDs 2a and 2b and includes EC; Tables 9, 10 (App. A.3) are added.
Q3 (transfer to the policy's own plans; responsive traffic)
Answer: We add two quantities to Table 5 and track one through training: ECref, the indicator against a common frozen reference, and dref, the normalized drift to it. Reactive-traffic validation is not possible on NAVSIM, which is non-reactive by construction, so no responsive-vehicle experiment is run and every method shares this protocol.
Evidence: ECref orders variants identically to benchmark EC, computed between the policy's own consecutive plans: ECref = 65.47, 64.52, 66.36 against EC = 69.80, 68.98, 72.12 for IDs 1--3, both giving ID 3 > ID 1 > ID 2. As ECref uses one frozen reference for every row, the identical ordering shows that coherence against the frozen reference carries over to coherence between the policy's own plans. For the drift, dref at the start of Stage 3 is 0.2522, 0.2676, 0.2752, varying by 9% across variants whose EC spans 68.98 to 72.12 and whose EP spans 92.27 to 93.51; tracking it per Stage-3 epoch gives an increase of at most 15% and a maximum of 0.32, so the gap stays bounded.
Boundary: The non-reactive protocol limits the claim to navtest consistency, not responsive traffic or closed-loop execution (Sec. 6).
Revision: Table 5 includes the dref and ECref columns for IDs 1--3; Sec. 5.3 reports the per-epoch drift.