- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper aims to expand the distribution of driving training data by using the uncertainty of the trajectories predicted by the planner as a guidance signal. The authors build a scenario generator on top of Scenario Dreamer, measure the uncertainty of the output of a frozen planner under dropout inference, and use it to steer the direction of the next denoising step of scene generation. A learnability measure is introduced to counterbalance the uncertainty guidance, so that the generation does not drift toward driving scenarios that are too hard to be solvable. The authors split the nuPlan dataset into out-of-distribution and in-distribution subsets, and on the in-distribution subset they augment the training data distribution with decision-uncertainty-guided synthetic data. Experimental results demonstrate the effectiveness of the proposed method, and the usefulness of the augmented training data is positively correlated both with the direction of the decision uncertainty and with the magnitude of the uncertainty.
Critical strengths
The idea of using the intrinsic uncertainty in the output of an off-the-shelf planner to guide scenario generation is novel, and the implementation is low-cost and scalable.
The experimental design is sound and sufficiently thorough. The results in Tables 1–4 clearly show the advantage of the training data distribution augmented by the proposed method over the unguided one, the gap between the augmented training data distribution and the upper bound of the data distribution (training data that includes the OOD set), the effect of the learnability term, and the advantage of high uncertainty over high certainty as the guidance direction.
The authors present the implementation details of the proposed method clearly and sufficiently.
Critical weaknesses
My concern is that the proposed decision uncertainty may guide data production along the scene distribution rather than along scene difficulty. Uncertainty may arise not only from the difficulty of the driving decision in a scene, but also from road structure alone: for instance, the space of possible driving decisions at an intersection is far larger than on a straight road, so a decision model's output uncertainty in a simple intersection scene may well exceed its output uncertainty in a difficult straight-road scene. Have the authors observed how the decision model's output uncertainty relates to factors such as road structure, ego state, and the states of surrounding agents, and what the road-type distribution of the synthetic data is?
Questions for authors
- Please check W1.
- Although the public release of UncArms postdates the submission of this paper and therefore does not affect its contribution, I believe that adding a discussion comparing it with UncArms (Uncertainty-Driven Self-Play for Robust Multi-Agent Driving Policies) would be beneficial.
2 comments
Rebuttal by Authors
Response to Reviewer UMvq (2/2)
[Q2] Comparison with UncArms: Thank you for pointing us to UncArms [2], which we read with great interest. UncArms trains multi-agent driving policies by closed-loop self-play, in which half of the agents are rewarded for raising the MC-dropout uncertainty of their neighbors. Its analysis shows that scenarios with higher uncertainty fail more often, which supports the same premise as POSG, namely that a policy's own uncertainty marks what it has not learned.
We think the two methods are complementary. UncArms exploits uncertainty in closed loop with reactive agents, but its scenarios start from recorded maps and initial states, so it explores new behaviors within recorded scenes. POSG instead generates new scenes, including new road layouts and agent configurations, so it is not limited to recorded scenes. Its generated futures, however, are fixed, so it trains the planner in open loop. A natural next step is to use POSG scenes as starting points for closed-loop training with reactive agents, as in UncArms, which would carry the benefit of POSG into closed loop.
We added the closed-loop extension of POSG to the conclusion (Section 6) as future work. We also cite UncArms as concurrent work in Appendix D.3, for its finding that uncertainty predicts closed-loop failures, and in Appendix D.4, for closed-loop training with reactive agents.
Thank you again for your time and effort in reviewing our work. We have carefully considered your valuable comments and tried our best to address your concerns with the clarifications and the additional experiments. If our response has addressed your primary concerns, we would greatly appreciate it if you could update your score to reflect that. We are also willing to discuss with you if you have any further concerns.
[2] Sajad Marvi, Julian Schmidt, Alessandro Canevaro, Julian Jordan, and Abhinav Valada. Uncertainty-Driven Self-Play for Robust Multi-Agent Driving Policies. arXiv:2610.19714, 2026.
Rebuttal by Authors
Response to Reviewer UMvq (1/2)
Thank you for your thoughtful comments and positive assessment. We are pleased that you found the use of the planner's intrinsic uncertainty novel, the implementation low-cost and scalable, the experimental design sound and thorough, and the implementation details clear. We would like to address your comments and questions below:
[W1 & Q1] Uncertainty, road structure and ego state: Thank you for this insightful question. We agree that the uncertainty of a planner's output can rise with road structure alone, since a scene such as an intersection admits more valid maneuvers than a straight road. The variance of the output rises both when a scene admits several valid futures and when the planner has not learned the scene, whereas an input that a network has not learned is characterized better in its representation space [1]. This is why U(x) measures the dispersion of the planner's hidden representations rather than that of its output trajectory (Section 4.1).
To examine whether U(x) still follows road structure or ego state, we compared the 12,500 scenes with the highest uncertainty among 50,000 unguided scenes with the whole pool and with recorded OOD scenes, as shown in the table below. The uncertain scenes have fewer lanes and agents than both the pool and the recorded OOD scenes, so uncertainty does not simply follow complex road structures such as intersections. On the 42,852 held-out recorded scenes, the rank correlations of U(x) with the number of lanes and the number of agents are also weak (−0.14 and −0.24). As for the ego state, the uncertain scenes concentrate at medium speeds of 2 to 10 m/s and rarely reach 10 m/s or more, a range that recorded OOD scenes also cover more often than the pool. Instead of road structure, U(x) follows the planner's error, with a rank correlation of 0.43 with the error of the frozen planner on the held-out recorded scenes and of 0.55 on their OOD group. This means that U(x) tracks what the planner has not learned rather than road structure or ego state alone. Guiding the generation by U(x) therefore leads POSG to the scenes that the planner still needs, rather than merely to complex road layouts.
\text{Scenes} & \text{All 50,000 unguided} & \text{Top 25\\% by U(x)} & \text{Recorded OOD (held-out)} \\\\ \hline \text{Lanes per scene} & 18.5 & 15.7 & 24.6 \\\\ \text{Agents per scene} & 15.1 & 12.1 & 18.5 \\\\ \text{Ego speed below 2 m/s (\\%)} & 40 & 24 & 41 \\\\ \text{Ego speed of 2 to 10 m/s (\\%)} & 38 & 74 & 52 \\\\ \text{Ego speed of 10 m/s or more (\\%)} & 22 & 2 & 7 \end{array}$$ Lanes and agents are means per scene, and ego speed is taken at the start of the scene. Recorded OOD is the OOD group of the 42,852 held-out recorded scenes (14,446 scenes). We added these analyses to Appendix D.3 of the revised paper. We believe this analysis addresses your concern about road structure and ego state. [1] Kimin Lee, Kibok Lee, Honglak Lee, and Jinwoo Shin. A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attacks. NeurIPS, 2018.