- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a scene-adaptive inference framework to improve the efficiency and planning performance of diffusion-based driving vision-language-action (VLA) models. The authors analyze trajectory readout quality across network depth and decoding stages, observing that intermediate-to-late hidden representations can support accurate trajectory prediction after a single forward pass. Based on these observations, the proposed framework combines a scene-adaptive readout Mixture-of-Experts (MoE) with an adaptive decoding policy that selectively performs additional refinement. Experiments on two diffusion driving VLAs demonstrate substantial inference speedups while improving trajectory planning performance.
Critical strengths
S1. Significant inference efficiency improvements. The proposed method achieves substantial end-to-end speedups of up to while preserving or improving trajectory planning performance. These improvements are particularly meaningful given the high computational cost of iterative decoding in diffusion-based driving VLAs.
S2. Interesting analysis of trajectory representations. The analysis of trajectory readout across network depth and decoding stages is interesting. In particular, the observation that useful trajectory information can be extracted from intermediate-to-late representations after the first forward pass provides a compelling motivation for reducing unnecessary diffusion decoding.
S3. Evaluation across different diffusion VLA architectures. The improvements on two different diffusion driving VLAs, together with evaluations on Waymo E2E and nuScenes, support the practical applicability of the proposed approach.
Critical weaknesses
W1. Limited justification for the complexity of the proposed framework. The method combines multiple components, including layer-specific readout heads, latent editors, a scene-adaptive MoE, an auxiliary readout branch, and an adaptive decoding policy. While the overall framework achieves strong empirical results, the motivation and necessity of several individual components are not sufficiently clear. Although component-wise ablations are provided, a more principled explanation of the overall design would strengthen the methodological contribution.
W2. Insufficient explanation of trajectory readout behavior across decoding stages. One of the most interesting observations is that the first forward pass achieves the highest trajectory readout RFS for a substantial proportion of scenes, while additional decoding can sometimes reduce performance. However, the underlying reason for this behavior remains unclear. In particular, it is difficult to determine whether the degradation results from changes in trajectory representations during iterative decoding or from the use of separately trained, stage-specific supervised probes. Further analysis would help clarify whether the observed behavior reflects an intrinsic property of diffusion decoding or the readout evaluation procedure.
W3. Unclear necessity of scene-adaptive layer selection. The paper motivates scene-adaptive readout through variation in the oracle-optimal layer across scenes. However, Appendix Table A2 shows that L27 receives the largest mixture weight for the vast majority of scenes. This raises the question of whether scene-conditioned fusion offers a substantial advantage over a simpler fixed-layer readout. Comparisons against fixed-layer readout and simple non-adaptive fusion strategies would help establish the contribution of the proposed MoE.
Questions for authors
Q1. Role of the one-pass draft in early trajectory readout. Equation (5) uses both intermediate-layer hidden representations and the one-pass draft obtained from the final LM head. If intermediate representations already contain sufficient information for accurate trajectory prediction, what additional benefit does the one-pass draft provide? An ablation comparing hidden-state-only, draft-only, and combined readout would help clarify its role.
Q2. Rationale for the adaptive decoding stopping criterion. The decoding gate activates additional refinement when the initial readout is predicted to benefit from further decoding. However, the refinement process terminates when the intermediate prediction becomes sufficiently close to the initial readout. Why should agreement with the initial prediction indicate that further refinement is unnecessary, particularly when that prediction was considered insufficient?
Q3. Endpoint-based trajectory agreement. Equation (15) determines the stopping point using only the distance between the final predicted waypoints. Since two trajectories can have similar endpoints while following substantially different paths, what motivates using endpoint agreement rather than a full-trajectory discrepancy? An ablation or sensitivity analysis would help justify this design choice.