- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
1.Dataset: They construct Cap4DR with 86,016 radar-image-text samples for alignment pretraining and OmniHD-QA with 520,161 question-answer pairs for instruction tuning across scene description, key-object reasoning, occupancy understanding, and trajectory planning; 2. Method: They propose RCVLA, a radarcamera VLA framework consisting of a radar-grounded semantic reasoning stage (RCVLA-Sem) and a trajectory arbitration stage (RCVLA-Phys). 3. Result: On OmniHD-QA, RCVLA-Sem improves CIDEr by 9.92 points and reduces key-object velocity error by 21.9% relative to OmniDrive. RCVLA-Phys further reduces average L2 error from 0.348 to 0.259m and average open-loop collision rate from 0.576% to 0.175% relative to RCVLASem.
Critical strengths
- Motivation&dataset: They construct two datasets and develop RCVLA to adapt 4D radar into VLA model. Cap4DR contains 86,016 4D radar-image-text samples for radar–language alignment pretraining, with 4D radar relevant entities verified through multi-model cross checking and selective manual review.
- Reasonable Architecture&System: RCVLA combines a reference trajectory from semantic reasoning, structured scene queries, and direct 4D radar measurements for trajectory refinement and risk-aware selection.
- Improvement on result: Experiments on OmniHD-QA demonstrate improvements in semantic reasoning and open-loop planning over the evaluated baselines.
Critical weaknesses
- Limited novelty: This paper is more like the system framework instead of introducing a methodological contribution. Specifically, this system is similar to DiffusionDrive[1] with the radar version.
- Like in the First problem, the advantage of using radar is not well illustrated. Without radar,the model obtain the better trajectory result in Table 4, in L2 and Coll result;
- All reported results are based on open-loop evaluation, which is insufficient since it can not evaluate something like recovery from planning errors.
- The alignment with radar is not well verified since the alignment dataset is build via camera images without radar, and the training procedure is also with image input;
[1] DiffusionDrive: Truncated Diffusion Model for End-to-End Autonomous Driving
Questions for authors
- As discussed in the Weaknesses section.
- Could the authors provide more results to better demonstrate the contribution of radar.
- Could the authors clarify how radar-language alignment is verified, given that the descriptions and entity validation in Cap4DR are mainly based on camera images?
5 comments
Dear Reviewer gAMk,
We sincerely appreciate your constructive feedback. We have addressed your concerns through additional experiments and manuscript revisions, with all changes highlighted in blue.
We hope these efforts have satisfactorily addressed your concerns and welcome any further suggestions.
Best regards, The Authors
Reply for Authors
Thanks for the additional experiments and explanations. They provide some evidence for contribution of radar, but the radar-language alignment is still not well verified for camera-derived descriptions. Also, the novelty and lack of closed-loop evaluation remain concerns. I would like to maintain my original rating.
Additional Radar Ablations, Alignment Verification, and Novelty Clarification
W1: Novelty
We acknowledge that truncated diffusion and trajectory anchors build upon DiffusionDrive. However, RCVLA goes beyond simply incorporating radar into an existing planner. Our main contributions include: (1) radar–language alignment through Cap4DR and RQ-Former; (2) gated camera–radar interaction for semantic reasoning and structured scene queries; and (3) radar-cluster conditioning for trajectory generation and TTC-based risk calibration for candidate selection. These designs enable the complementary use of 4D radar in both semantic understanding and physical planning. We will further clarify these distinctions in the revision.
W2/Q2: Contribution of 4D Radar
We acknowledge that Table 4 evaluates RCVLA-Sem alone: removing radar yields a lower Sem-stage collision rate of 0.391%, compared with 0.576% for the full Sem model. Improved semantic metrics alone do not ensure safer reference trajectories. We therefore report final RCVLA-Phys results from joint radar-component ablation and alternative semantic-stage variants.
Jointly removing radar-cluster conditioning and TTC calibration from RCVLA-Phys increases the average L2 error from 0.259 to 0.339 m and collision rate from 0.175% to 0.391%, while retaining radar-enabled RCVLA-Sem. Radar-cluster conditioning guides candidate generation, whereas TTC calibration adjusts candidate ranking, which may explain the non-monotonic collision rates across ablations. We further evaluate the contribution of radar-informed semantic outputs while keeping radar available in RCVLA-Phys. Removing radar from RCVLA-Sem increases the final collision rate to 0.329%, while removing radar–language pretraining raises it to 0.422%. These comparisons support the contribution of radar to both stages, although the effects of reference trajectories and structured scene features are not separately isolated. Finally, replacing matched radar velocities with GT planar velocities yields a finite-TTC MAE of 0.272 s and changes candidate selection in only 1.327% of frames, with the average collision rate remaining 0.175% under both velocity settings.
W3: Open-Loop Evaluation Limitations
We agree that open-loop evaluation cannot assess closed-loop recovery or guarantee driving safety. Table 6 tests delayed semantic references and thus probes robustness to stale inputs, but is not a closed-loop perturbation or recovery test. We clarify this limitation in the revision.
W4/Q3: Radar–Language Alignment Verification
Camera images are used to construct radar-oriented language supervision, whereas radar features are the input during radar–language pretraining. Cap4DR contains 86,016 synchronized radar–image–text samples. Camera-generated descriptions focus on traffic participants and spatial relations, excluding visual appearance attributes. Three VLMs cross-check extracted entities against the images, with ambiguous cases manually reviewed. During pretraining, the radar encoder and LLM are frozen; RQ-Former learns from radar features and paired descriptions without image inputs.
The gains over removing radar–language pretraining support its downstream semantic and motion benefits, but do not verify explicit radar-point-to-text correspondence. Our approach uses camera-assisted, paired radar–language supervision rather than instance-level radar–text annotations.