- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces RADIUS-Drive, a benchmark for evaluating vision-language models in safety-critical driving scenarios. Its main argument is that a model may produce the correct driving action without actually recognizing or understanding the underlying risk. To address this issue, the authors divide the evaluation into three stages—safety, risk awareness, and decision reasoning—and evaluate 15 general-purpose VLMs and four language-model-based driving agents on 550 image-based scenarios.
Critical strengths
- The problem of obtaining the correct answer for the wrong reason is important, especially in safety-critical settings.
- The stage-wise evaluation and broad model coverage help identify whether failures arise from risk recognition or decision-making.
Critical weaknesses
- Although RADIUS-Drive is positioned as an autonomous driving benchmark, it mainly evaluates VLM reasoning over single images. It excludes temporal and multimodal inputs and relies on a simplified 2D simulator, creating a substantial gap between its broad AD framing and what it actually measures.
- The benchmark only checks whether a model’s explanation matches human annotations. It does not establish that the stated risk factors actually caused the decision, and no counterfactual evaluation is provided.
Questions for authors
- How can the safety scores be considered reliable when models predict control-related quantities from a single image without depth, motion, or ego-state information?
- What evidence shows that the stated risk factors actually drive the model’s decision rather than serving as post-hoc explanations?
3 comments
Response to Reviewer DdLf (Part 2/2)
Q1: Reference Scene States for Safety Evaluation
A: We thank the reviewer for their attention to the reliability of Safety scoring. We would like to clarify that we construct simulator-ready scene-state annotations containing spatial and kinematic information for each sample.
Specifically, Appendix C.3 of the original manuscript already explains that each sample includes a coarse 2D road representation and kinematic state, including road geometry, road boundaries, and the categories, positions, and velocities of surrounding traffic participants. The longitudinal axis is aligned with the ego vehicle's forward direction, while the lateral axis represents cross-lane motion. Appendix D.4.1 further specifies that we construct a simulator-ready scene state for each scenario, including the ego state, road geometry, and the positions, dimensions, and plausible velocities of surrounding traffic participants. We also annotate actions in the discrete control space according to whether they result in collisions, trigger high-dynamic hazards, or remain safe. This information is stored in accompanying data files, such as dataX_aligned.json, for use by the deterministic simulator, rather than requiring the model to directly predict these physical states from the image alone.
Therefore, the Safety evaluation follows a clear procedure: the model predicts a pre-decision action based on the image, while the simulator independently evaluates that action through short-horizon kinematic simulation and collision detection using the corresponding annotated physical scene state. This avoids directly relying on potentially inaccurate spatial or motion estimates produced by the evaluated model itself and ensures that different models are evaluated under identical scene states and simulation conditions.
We will further clarify the specific contents of these physical-state annotations in the revised manuscript.
Follow-up on Our Response
Dear Reviewer DdLf,
Thank you again for your valuable feedback. We would like to follow up on our previous response.
To address your main concerns, we have further clarified RADIUS-Drive's research positioning and evaluation scope, emphasizing that our work aims to diagnose risk understanding and decision grounding in static safety-critical scenarios, rather than replace comprehensive temporal or closed-loop driving evaluations. Meanwhile, we have conducted additional counterfactual perturbation experiments, demonstrating the significant sensitivity of models' final decisions to intermediate risk judgments. In addition, we have further clarified that the physical states used for Safety scoring are derived from independent scene annotations, rather than quantities predicted by the models from a single image, and provided a detailed explanation of the evaluation mechanism and applicable scope of our short-horizon simulation.
We hope these clarifications help resolve potential misunderstandings and adequately address your main concerns. Furthermore, the additional experimental evidence provides further support for the core contributions and evaluation value of our work. If you have any remaining questions, we would be more than happy to provide further clarification and discussion. If you believe that these clarifications and additional experiments have sufficiently addressed your previous concerns, we sincerely ask that you reconsider the research contributions of our work in light of the more comprehensive evidence and consider revising your overall assessment and score accordingly.
Thank you again for taking the time to review our work. We look forward to hearing your further feedback.
Best regards,
The Authors
Response to Reviewer DdLf (Part 1/2)
W1: Temporal Dynamics and Evaluation Scope
A: We thank the reviewer for their attention to the evaluation scope of the benchmark. We would like to clarify that our work does not aim to establish a comprehensive benchmark covering all autonomous driving capabilities, but rather focuses on diagnosing risk understanding and decision grounding in safety-critical scenarios.
In fact, numerous studies published at major conferences have investigated related tasks using static driving images. For example, Talk2Car[1] studies visual object grounding in driving scenes, CODA[2] focuses on long-tail anomaly perception, CODA-LM[3] further evaluates long-tail scene understanding and driving recommendations, while DriveQA[4] examines traffic-rule understanding, right-of-way judgment, and driving-related reasoning based on static visual inputs. These studies demonstrate that single-frame visual perception, risk recognition, and decision-relevant reasoning remain meaningful evaluation targets even without temporal dynamics.
RADIUS-Drive specifically targets these diagnostic capabilities in static scenarios, rather than comprehensive temporal driving decision evaluation. Although existing studies can evaluate the correctness of visual understanding or driving recommendations, they still struggle to distinguish whether a model has genuinely identified the source of risk and whether its final decision is supported by corresponding risk evidence.
Similarly, the lightweight 2D simulator in our work is used only to assess immediate collisions and high-dynamic hazards during the Safety phase, rather than to simulate full vehicle dynamics or long-term traffic interactions. Its design prioritizes determinism, computational efficiency, and reproducibility while maintaining a replaceable simulation interface. As explicitly stated in Appendix C.3, the simulator serves as a reference evaluation backend rather than a high-fidelity vehicle dynamics environment. We will open-source the evaluation pipeline, allowing users to replace the reference simulator with their own simulators.
Therefore, we consider RADIUS-Drive complementary to temporal, multimodal, and closed-loop driving benchmarks, as they evaluate different capability dimensions. The contribution of our work lies in addressing the limitations of conventional outcome-oriented evaluation by introducing diagnosis of risk understanding and cross-phase decision grounding, rather than replacing comprehensive evaluation of complete autonomous driving systems. We will further clarify its research positioning as an image-based diagnostic benchmark for safety-critical driving, along with its scope and limitations, in the revised manuscript.
[1] Talk2Car: Taking Control of Your Self-Driving Car, Deruyttere et al., EMNLP 2019
[2] CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving, Li et al., ECCV 2022
[3] Automated Evaluation of Large Vision-Language Models on Self-Driving Corner Cases, Chen et al., WACV 2025
[4] Passing the Driving Knowledge Test, Wei et al., ICCV 2025
W2&Q2: Counterfactual Validation of Risk-Driven Decisions
A: We thank the reviewer for this question. We further designed a counterfactual perturbation experiment to examine the actual influence of intermediate risk judgments on final driving decisions.
Specifically, we adopt a two-stage evaluation procedure. First, we obtain the model's structured risk judgments and decision-relevant factors for a given scene. Subsequently, while keeping the original scene image and all other inputs unchanged, we introduce controlled perturbations to the model's intermediate risk-factor judgments and regenerate the final driving strategy. By comparing final-decision accuracy before and after perturbation, we measure the extent to which the model relies on intermediate risk judgments.
The experimental results show that perturbing intermediate risk judgments leads to decreases of 20.83, 25.00, and 22.50 percentage points in final-decision accuracy for GPT-4o, Gemini-2.5-Flash, and GPT-5.1, respectively. These results indicate that changes in intermediate risk factors have a substantial influence on the models' final decisions, rather than merely serving as post-hoc explanations independent of the decision-making process. This counterfactual experiment further supports the necessity of jointly diagnosing risk recognition, decision-relevant factors, and final driving strategies in RADIUS-Drive.
We will include the above experimental setup and results in the revised manuscript.