- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper face the problem of continual policy improvement for autonomous driving in interactive Gaussian worlds. It focuses on handling heterogeneous safety constraints without conflicting optimization objectives, and adapting the training scenario distribution as the policy improves. The authors propose World2Policy, a co-evolutionary framework consisting of a Policy Optimization Engine and an Environment Engine. The former trains three constraint-specialized experts using constrained PPO to address different driving risks, and employs a privileged selector to choose trajectories based on safety, progress, and comfort. The latter identifies recoverable failures from closed-loop rollouts and uses CEM to generate physically valid, challenging scenarios for subsequent policy updates.
Experiments on the HUGSIM benchmark show that World2Policy improves the HD-Score of UniAD, VAD, and LTF by 4.9, 6.1, and 6.9 points, respectively. Ablation studies further examine the contributions of multi-expert optimization and failure-conditioned scenario generation.
Critical strengths
The paper addresses an important limitation of closed-loop policy learning: fixed training scenarios may become less informative as the policy improves. The proposed co-evolutionary framework provides a reasonable way to address this issue by generating new scenarios based on the policy's observed failures. The recoverability filtering and physically constrained scenario editing are particularly useful, as they help avoid unrealistic or unsolvable adversarial cases. The results in Table 4 provide evidence that failure-conditioned generation produces more challenging and effective training scenarios than random perturbations.
Critical weaknesses
-
A major concern is the reliance on privileged trajectory selection during evaluation. As described in Section 5.1, the selector chooses one trajectory from 48 candidates at each decision step. It evaluates candidates using dynamic-actor risk, geometric safety checks, drivable-area compliance, progress, and comfort. These criteria also closely align with the components of the HUGSIM HD-Score. The paper does not clearly specify which privileged signals are available to the selector at test time, or whether it accesses simulator ground-truth states and geometry. If such information is used, the reported improvements may partly arise from an information advantage at inference time rather than the learned policy itself. This raises concerns about evaluation fairness, performance attribution, and real-world applicability. The authors should clarify the selector's inputs and provide comparisons without test-time privileged information, under matched candidate budgets.
-
Although continual policy improvement is a central claim of the paper, the experiments only demonstrate two rounds of scenario-curriculum updates. This is insufficient to establish whether the gains can be sustained over longer training horizons or whether the policy eventually saturates or regresses. Moreover, the main mechanism ablations are conducted on a 64-scenario subset using only the LTF backbone. The paper also lacks results across multiple random seeds and uncertainty estimates. These limitations make it difficult to assess the stability and generality of the reported improvements. Longer curriculum experiments and statistical evaluations would strengthen the paper's central claim.
Questions for authors
Could the authors report results using an observation-based selector that does not access privileged simulator information? It would also be valuable to compare single-expert and multi-expert policies under the same candidate budget. Such experiments would help disentangle the contributions of expert specialization, candidate diversity, and privileged trajectory selection to the final HD-Score improvement.