- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies test-time adaptation of end-to-end autonomous driving models under distribution shifts, focusing on task dependencies between perception and planning and potential parameter drift during continual updates. The authors propose CroTTA, which combines binary entropy minimization of perception outputs with a delayed planning consistency loss based on observed ego-vehicle displacement. The adaptation process is constrained by an projection centered on exponential moving average (EMA) parameters and a stepwise update acceptance mechanism. Only a subset of LayerNorm affine parameters is updated. The experiments cover six models on nuScenes and five planners on NAVSIM, evaluated under various visual corruptions, time-varying perturbations, localization noise, cross-city transfer, and scenarios involving strong interactions. The results show improvements in planning error and collision-related metrics in most reported settings. However, the continual adaptation protocol needs clearer documentation, and the attribution of the gains and the verifiability of some reported recovery rates require further support.
Critical strengths
1.The method combines practically meaningful adaptation signals for end-to-end driving and achieves substantial improvements. Linking perception uncertainty to observed ego-vehicle motion is more task-specific than simply increasing prediction confidence. For example, under severe Gaussian noise, UniAD’s average L2 error decreases from 1.38 m to 1.25 m, and its average collision rate decreases from 0.95% to 0.72%, corresponding to relative reductions of approximately 9.4% and 24.2%, respectively. Table 5 also shows that combining the two losses yields better collision metrics than using either loss alone. These results directly support the method’s potential value. (Pages 7 and 9; Tables 2 and 5.)
2.The experiments provide broad coverage and useful evidence beyond successful cases. In addition to evaluating multiple models on nuScenes and NAVSIM, the appendices include experiments on clean data, fog, brightness, snow, time-varying contrast, joint perturbations involving GPS/yaw noise and motion blur, and geographic transfer from Boston to Singapore. The authors also present cases where adaptation increases error and acknowledge that severe localization errors and inappropriate learning rates can cause failures. These experiments help establish the method’s applicability and limitations, increasing the practical value of the findings. (Appendices A–C and G–H.)
Critical weaknesses
1.The execution protocol and stability evidence for the core online adaptation mechanism are insufficient, limiting assessment of the main contribution. Equations (8)–(13) rely on the discrepancy between the previous frame’s plan and the currently observed motion, but do not specify the exact sequence of differentiable recomputation, historical state handling, candidate update validation, and final scoring. This particularly affects understanding of how cross-frame adaptation is implemented in NAVSIM. Meanwhile, projection around a moving EMA center directly constrains only the parameters’ deviation from the current center; it does not, by itself, establish bounded long-term parameter drift or prevent model collapse. The existing ablations introduce EMA, projection, and update filtering jointly as P, while the explicitly described experiment with time-varying perturbations spans only 20 frames. Thus, the mechanisms claimed to support cross-task coordination and long-term stability have not been sufficiently isolated and validated. (Pages 5–7, Equations (8)–(13); Appendices A.5 and E.) 2.The comparisons underlying the key gains and the quantitative reporting contain substantive issues that hinder verification. Appendix F.1 explicitly restricts the main baselines to updating LayerNorm parameters in the perception classification branch, whereas the exact parameters updated by CroTTA for each architecture are not specified. Tent in Table 4 and the Lmm-only variant in Table 5 produce different results; their implementation differences need to be clarified to attribute the gains to the new mechanisms accurately. Furthermore, the VAD recovery rates in Table 2 are incompatible with the clean reference values in Table 7. Table 15 calculates recovery rates for the subset involving strong interactions using reference values from the full validation set, so these rates cannot be directly interpreted as recovery from corruption-induced degradation on that subset. The results for the full method on SparseDrive also differ between Tables 2 and 20. These issues reduce confidence in the magnitude of the contribution and its reproducibility. (Pages 7, 9, 15, 19, and 21–22.)
Questions for authors
Q1. Baseline comparisons and attribution of contributions — clarification and validation are needed. Please specify the parameter modules updated by each method, the number of update steps, and the optimization settings. Why do Tent in Table 4 (1.37/0.94) and the Lmm-only variant in Table 5 (1.33/0.92) produce different results? When the updated parameters and delayed motion feedback are matched, does the proposed stabilization mechanism still offer advantages over existing continual adaptation mechanisms? Q2. Long-term stability — targeted validation is needed. Could you separately ablate EMA, the L∞ projection, and the acceptance/rollback mechanism, and report performance, parameter drift, and update acceptance rates over longer continuous streams or repeated domain switches, explicitly without resetting parameters? Do these results support the claim of preventing model collapse, or would it be more appropriate to limit the conclusion to empirical improvements under the tested conditions? Q3. Recovery rates and consistency of results — corrections or explanations are needed. Please verify the VAD model versions and clean reference values in Tables 2 and 7, the results for the full method on SparseDrive in Tables 2 and 20, and the denominators used to calculate recovery rates in Table 15. Please also provide the clean reference scores for NAVSIM and uncertainty estimates for the task metrics, so that readers can assess the small absolute gains and verify the corresponding recovery rates. Q4. Efficiency and deployment claims — clarification is needed. What hardware and numerical precision were used for the timing measurements in Table 6? Do these measurements include recomputation of the previous frame, backpropagation, candidate update validation, and final prediction? What is the total end-to-end latency with adaptation enabled? In real closed-loop operation, where displacement feedback is generated by the policy’s own actions, how do you characterize the validity of Ltemp and its relationship to planning safety?