- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Recon4Drive, a vision-language-action framework that transfers pretrained 4D reconstruction features to autonomous driving. Its Semantic-Guided 4D Retriever (SG4R) uses image-derived queries to compress dense SLARM features into 180 tokens. Planning-Critical Structured Scene Encoding (PSE) introduces 12 supervised queries representing lane boundaries, nearby agents, and their future motion. A flow-matching DiT planner generates trajectories from the resulting VLM hidden states.
Critical strengths
1.Strong closed-loop results in a clearly specified comparison setting. The reported 62.27% SR and 85.45 DS exceed MindDrive by 4.01 percentage points and 4.86 points, respectively. The 91.11% overtaking score is particularly encouraging for a method intended to improve geometric and interaction understanding. Closed-loop evaluation across 220 routes provides consequential evidence beyond open-loop trajectory accuracy. 2.An effective compact interface between reconstruction and planning. SG4R reduces the 4D tokens entering the VLM from 2,592 to 180. With PSE enabled, the compressed model improves SR and DS over the dense counterpart in Table 2 while substantially reducing measured VLM latency. This is a useful practical contribution: pretrained reconstruction representations can be incorporated without passing their full dense token sequence into the language model.
Critical weaknesses
1.How does an image-only model with the same PSE supervision perform? Could you also compare supervised relation queries with the same number of learnable queries without relation supervision, while keeping the planner interface otherwise identical? These comparisons would help determine whether the gains specifically arise from combining 4D features with explicit planning relations, or can largely be explained by auxiliary supervision and additional conditioning capacity. 2.Table 7 compares encoders that differ in architecture and pretraining as well as their treatment of dynamics. What evidence supports attributing SLARM’s advantage specifically to dynamic information? Could you provide a controlled comparison using the same SLARM encoder with and without informative temporal input, while keeping the training setup and token budget consistent? 3.In Table 8, SG4R achieves the same SR as Fixed Image Query and improves DS by 1.08, while its DS advantage over Learnable Query is 0.19. Are these differences consistent across repeated runs? Could you provide evidence that the learned camera aggregation in SG4R offers a reliable benefit over these simpler retrieval alternatives? 4.Appendix B.3 states that the reported latency and GFLOPs cover only the VLM. What are the total inference latency and planning frequency when SLARM encoding, SG4R retrieval, VLM processing, and DiT sampling are included? Please specify the hardware and feature-caching setup, and compare against the image-only baseline under the same conditions to clarify whether the additional system-level overhead is indeed small.
Questions for authors
see Weaknesses
2 comments
We thank the reviewer for the careful consideration of our responses. We appreciate the constructive comments, which have helped us clarify our technical contributions and strengthen the experimental validation of our work.
Thanks to the author's reply, the author has resolved most of my concerns. I will adjust my score to 3, but similarly, my confidence is 2 because I haven't conducted research directly related to this field.