- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies how to identify safe regions of scenario parameters for end-to-end autonomous driving models. The authors propose ODIN, a framework that uses decision trees to learn statistically safe and locally maximal parameter regions. ODIN runs driving simulations to check the learned regions and iteratively updates the decision trees using safe and unsafe samples. The authors evaluate ODIN on seven safety-critical scenarios in CARLA using the TransFuser model. The results show that ODIN converges across different decision tree depths and can find pairs of safe and unsafe scenarios near the learned region boundaries.
Critical strengths
-
The paper studies a meaningful problem in autonomous driving safety evaluation. Learning safe parameter regions can help understand the conditions under which an autonomous driving model behaves safely. The boundaries of these regions can also provide useful safe and unsafe scenario pairs for analyzing model failures.
-
The proposed framework provides an interpretable way to describe safe parameter regions using decision trees. The authors also evaluate the framework on seven different driving scenarios in CARLA. The results show that ODIN can converge across different tree depths and identify safe and unsafe configurations near the learned boundaries, which supports the feasibility of the approach.
Critical weaknesses
-
The first concern is that the advantages of the proposed framework over other approaches are unclear. Each scenario is represented by a small number of parameters, and the simulator provides safe or unsafe labels for sampled configurations. It seems possible to directly sample the parameter space and learn the safe/unsafe boundary using a classifier or a prediction model. However, the paper does not compare ODIN with such approaches. It also does not evaluate the coverage or boundary accuracy of the learned safe regions. Without these comparisons, it is difficult to understand the necessity and practical benefits of the proposed framework.
-
The second concern is the limited experimental evaluation. ODIN learns a separate safe region for each predefined scenario, and the experiments only consider one autonomous driving model. It is unclear how useful these learned regions would be when the driving scenarios or models change. Therefore, the current experiments provide limited evidence of the broader usefulness of the proposed approach.
Questions for authors
I think the authors should provide more analysis and evidence to demonstrate the value of the proposed framework. Specifically:
-
Could the authors provide additional comparisons or analyses to show its benefits in terms of safety region coverage, boundary accuracy, or simulation efficiency?
-
Could the authors clarify whether ODIN needs to learn a new safe region from scratch when the driving scenario or autonomous driving model changes? How practical is this approach when applied to a large number of scenarios or different driving models?
2 comments
Thank you for the clarifications. However, my main concerns remain unresolved.
Response to Reviewer F7mP
We thank the reviewer for their comments and address their main concerns below:
Yes, we will provide in the final version, a baseline that samples configurations randomly from the entire space, and learns trees for a bounded number of samples/iterations, followed by testing it for safety and maximality, similar to the current evaluation. This will help understand the effect of guiding the sampling using counterexamples and focusing on safety and maximality testing.
Yes, ODIN learns a new safe region for each driving scenario and model. Learning a safe region from scratch is necessary for different models, of course, because they can exhibit different safety regions. The intent behind ODIN is that practitioners can use it on representative scenarios that are relevant to their deployments and get an understanding of their model's behavior in different configurations of a scenario. However, when models evolve (e.g., improve), we see a path to extend ODIN to incrementally build safe regions, evaluating safety and maximality (but with the same set of anchor points), and continuing the learning algorithm. We leave this for future work.