- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
- This paper introduces interaction distribution shift (IDS), where an ego trajectory remains supported marginally but becomes incompatible with the surrounding-agent futures recorded in the dataset.
- The proposed ICDP framework decomposes joint-support degradation into ego-support and interaction-support components. It estimates the latter through the difference between joint and ego-only contrastive logits, and incorporates this estimate into diffusion-based offline policy optimization.
- Evaluation includes reactive and non-reactive nuPlan benchmarks, InterPlan scenarios, and qualitative deployment on a full-scale autonomous truck.
Critical strengths
- Clear formulation with a principled estimator. The paper precisely separates marginal ego-support degradation from conditional interaction-support degradation. Using shared negative proposals allows the ego-only score to cancel the proposal-dependent component of the joint score, providing a coherent rationale for the residual estimator.
- Encouraging closed-loop results. Under the controlled backbone comparison in Table 2, ICDP improves reactive scores over unconstrained Offline RL from 70.07 to 72.87 on Test14-Hard and from 83.02 to 86.34 on Test14-Random. InterPlan evaluation and qualitative truck deployment broaden the evidence beyond a single benchmark setting.
Critical weaknesses
- The central residual-estimation mechanism is not sufficiently isolated. Table 2 compares the complete framework with BC and unconstrained Offline RL, but does not establish the benefit of residual interaction regularization beyond ego-support regularization alone or direct joint-score regularization. Figure 2 also omits a zero-interaction-penalty setting. These controls, together with direct validation of interaction-score behavior, are important for attributing the gains to the paper’s main contribution.
- The evaluation leaves uncertainty about robustness and model selection. Table 2 reports variation across ten training checkpoints rather than independent training seeds. This measures temporal variability but cannot establish reproducibility across runs. Moreover, Section 5.2 motivates the final regularization weights using curves evaluated on Test14-Hard and Test14-Random. The authors should clarify whether these choices were independently determined on validation data and report results across independent seeds.
Questions for authors
- How does ICDP compare with ego-support-only regularization and direct joint-score regularization under matched training settings? Can the authors directly validate that subtracting the ego score improves interaction-specific discrimination?
- Can the authors report independently trained multi-seed results and clarify the validation protocol used to select regularization weights, agent capacity, and checkpoints?
- Why does ICDP score only 51.8 on InterPlan’s Nudge Around category, compared with 72.96 for Flow Planner? Does preserving compatibility with logged agent futures discourage useful deviations in these scenarios? A failure analysis would help establish the constraint’s practical boundaries.
4 comments
Official Comment by Authors [2/2]
W2 / Q2: Robustness across independent seeds and model selection
We agree that variation across checkpoints of a single run measures temporal variability rather than reproducibility across runs. The revision therefore retrains BC, Base Offline RL, and ICDP with four independent seeds (point 1) and clarifies that every hyperparameter was selected on held-out validation data, separate from the test benchmarks (point 2).
1. Are the gains reproducible across independently trained seeds? Table 2 now reports four independently trained seeds per method, each evaluated at the same ten checkpoints. The ± is the standard deviation over all 40 scores, so it captures variation across runs as well as across checkpoints. Across these seeds, ICDP improves reactive performance over Base Offline RL from 70.12 to 72.37 on Test14-Hard and from 83.24 to 86.46 on Test14-Random. These gains of +2.25 and +3.22 points are close to the +2.80 and +3.32 reported in the submission, and ICDP also achieves the highest mean in five of six settings and improves over BC in all six. Tables 1 and 7 follow the same protocol. The reactive gains therefore hold across independently trained runs, not only across checkpoints of a single run.
2. Were the regularization weights, agent capacity, and checkpoints determined on validation data? Yes. All choices use a held-out validation split built at the scenario level, which shares no source scenarios with training and no data with the test sets (Appendix B.1, Appendix B.4):
- Regularization weights: among the four settings compared, achieves the highest NR validation score (92.3;
Table 4). - Agent capacity: validation scores rise from 89.2 (24 agents) to 92.1 (32) and 92.3 (48), so we use 48 (
Table 5). - Checkpoints: none are selected; every seed is evaluated at the same ten checkpoints over the final 20,000 updates, and all are reported.
The test-set curves in Figure 2 were not used for selection, and Section 5.2 now states this explicitly. The validation-selected configuration is also the best setting on these test curves, showing that the validation choices transfer to the test benchmarks.
Q3: Nudge Around and the practical boundaries of the interaction constraint
1. Why does ICDP score lower than Flow Planner on Nudge Around? Under the same four-seed protocol (the submitted table averaged checkpoints from a single seed), ICDP obtains 63.80 ± 11.40 on Nudge Around (Table 7), rather than 51.8. The large standard deviation reflects the category's structure: it contains only ten scenarios, and each scenario's score is multiplied by a binary check of whether the ego passes the parked vehicle [2]. A scenario that fails this check scores zero, so one scenario can change the category by up to 10 points. Flow Planner's 72.96, a single reported value, lies within one standard deviation of our mean, and its own ablation reports 64.46 without classifier-free guidance [1, Table 4], comparable to ICDP. ICDP thus retains a lower mean Nudge Around score, while achieving the highest mean overall, High Traffic, and Jaywalk scores on InterPlan.
2. Does preserving compatibility with logged agent futures discourage useful deviations in these scenarios? No. In Nudge Around, the obstacle is a non-moving parked vehicle whose future does not depend on the ego. By the definition of IDS, the interaction penalty therefore does not apply to the obstacle, so nudging around it is not discouraged. Empirically, removing the interaction term () gives 60.8, close to ICDP's 63.80 given the category's high variance. Removing the constraint therefore does not close the gap to Flow Planner, indicating that the constraint is not the cause of the lower score.
3. What are the practical boundaries of the constraint? The interaction penalty acts only on agents whose logged futures depend on the ego, and the tolerance permits bounded interaction shift. Its boundary lies in beneficial maneuvers that create an interaction with moving agents that is absent from the data, such as merging into a gap that logged traffic never offered. There, the penalty discourages the maneuver unless its interaction shift stays within .
We thank the reviewer again for the constructive feedback, which led to clearer ablations and a stronger evaluation protocol. We hope these responses and the revised manuscript address the reviewer's concerns, and we are happy to clarify any further points.
[1] T. Tan et al. Flow matching-based autonomous driving planning with advanced interactive behavior modeling. In Advances in Neural Information Processing Systems (NeurIPS), 2025.
[2] M. Hallgarten et al. Can vehicle motion planning generalize to realistic long-tail scenarios? arXiv preprint arXiv:2404.07569, 2024.
Thank you for the detailed response. The matched ablations and direct validation clarify the contribution of the residual interaction term. The four-seed results and held-out tuning protocol address my concerns about reproducibility and model selection. I will consider raising my score.
We sincerely thank the reviewer for their positive and encouraging feedback. We greatly appreciate the reviewer's thoughtful comments and constructive suggestions, which have helped us further improve the quality and clarity of our paper.
Official Comment by Authors [1/2]
We thank the reviewer for the thoughtful review, and for recognizing the clear formulation and principled estimator, as well as the encouraging closed-loop results under the controlled backbone comparison. We address each point below.
To isolate the residual-estimation mechanism and attribute the gains to it, the revision adds two components. First, matched ablations of each regularization term, including the zero-interaction-penalty setting now shown in
Figure 2(points 1–2 below). Second, a new validation study of interaction-score behavior (Section 5.3,Appendix E; point 3 below), which tests whether the learned score detects interaction degradation and whether this degradation corresponds to driving failures. For example, across 626 validation scenes, the ego trajectories that our learned interaction score flags as most shifted from the logged interactions (highest quartile of estimated IDS) have more than ten times the safety-violation rate of those flagged as least shifted (16.52% vs. 1.53%).1. Does residual interaction regularization add benefit beyond ego-support regularization alone? Under matched training, we compare ICDP with ego-only (λI=0) and interaction-only (λE=0) regularization. On the validation split (
Table 4), ICDP scores 92.3, compared with 90.6 for ego-only and 91.2 for interaction-only: interaction regularization alone already outperforms ego-support regularization alone, and combining both performs best. The test benchmarks show the same ordering: averaged over Test14-Hard and Test14-Random (NR and R;Figure 2), ICDP reaches 82.64, compared with 81.20 for interaction-only, 80.80 for ego-only, and 80.70 for Base Offline RL. Adding residual interaction regularization to ego-support regularization therefore improves performance by 1.84 points on test and 1.7 on validation, establishing its benefit beyond ego-support regularization alone.2. How does ICDP compare with direct joint-score regularization under matched training settings? Joint-support degradation decomposes exactly as ΔJ=ΔE+ΔI (
Eq. 10). Regularizing the joint score directly therefore applies a single weight to both components, which corresponds to the equal-weight setting (λE,λI)=(1,1). This setting scores 91.4 on validation (Table 4) and 80.70 on test (Figure 2(a)), below ICDP's 92.3 and 82.64 with (0.3,1); on test, equal weighting gives no gain over Base Offline RL (80.70). ICDP therefore outperforms direct joint-score regularization, because the residual estimator separates the two components and allows ego shift to be penalized less than interaction shift.3. Does subtracting the ego score improve interaction-specific discrimination? Interaction-specific discrimination means distinguishing interactions that differ in how the ego and other agents fit together, rather than in how likely the ego trajectory is on its own. We verify the two properties this requires:
Appendix E.4), candidates come from a proposal that differs from the data, so the joint score mixes an ego component with the interaction component. After subtracting the ego score, the residual matches the true interaction ratio with R2 of 0.9995 (Gaussian) and 0.991 (nonlinear).Appendix E.3).Together, these results show that subtracting the ego score yields an interaction-specific signal, and that this signal discriminates degradations in interactions such as safety violations where the ego score alone is uninformative.