- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper puts forward FlowPlan, a flow-matching-based trajectory planning method for autonomous driving guided by counterfactual interaction consequences. Its core module, CF-ICM, works by taking different candidate ego trajectories and evaluating how each one affects surrounding objects over time, with outcomes sorted into three tiers: free clearance, near-gap, and contact. The method then uses coupled lateral–longitudinal behavior probes to construct strategy conditions and dynamic consequence memories, which steer the flow matching process during trajectory generation and candidate selection. For validation, the authors run experiments on the nuPlan closed-loop benchmark, and they also propose a new benchmark called nuPlan-CIP to test how planners respond to interaction perturbations. The final results show that FlowPlan achieves good performance across multiple reactive driving scenarios.
Critical strengths
-
The interaction-aware generation idea is well motivated and useful. FlowPlan does more than simply generate trajectories with Flow Matching: it explicitly models object- and time-level interaction consequences with CF-ICM and uses this information to guide the generation process through dynamically updated consequence memories. This makes the planner more directly aware of interaction risk during generation, rather than only evaluating risk after trajectories have already been produced.
-
The evaluation is fairly comprehensive and includes a useful diagnostic benchmark. Besides the standard nuPlan closed-loop evaluation, the paper introduces nuPlan-CIP to test whether the planner reacts appropriately to controlled changes in interaction intensity. The improvements, especially in reactive scenarios, provide useful evidence that the proposed consequence modeling helps the planner adapt to changing interactions.
Critical weaknesses
-
The “counterfactual” claim is not fully validated. CF-ICM is trained on logged trajectories together with alternative ego trajectories generated in reactive simulation, so its predictions may depend quite strongly on the simulator and its response model. The paper does not provide enough analysis of how well these predicted consequences transfer under different interaction dynamics or simulator mismatch. This matters because CF-ICM is the main signal used to guide trajectory generation.
-
The interaction space and diagnostic evaluation are still somewhat limited. The method uses nine manually defined combinations of lateral and longitudinal behaviors, which may not cover more complex or continuous interaction strategies. In addition, nuPlan-CIP is based on 140 base scenes, with only 46 conflict-increasing and 21 conflict-removing cases retained. This makes it harder to judge how broadly the reported interaction-aware behavior generalizes.
Questions for authors
-
Clarification on the “counterfactual” formulation. The paper describes CF-ICM as modeling counterfactual interaction consequences, but in practice it seems closer to predicting outcomes for alternative ego trajectories generated through reactive simulation. Could you clarify what exactly “counterfactual” means in this paper, and how CF-ICM differs from the interventional behavior prediction framework of Tang et al. (2022)? This would help me better understand the novelty of the formulation.
-
Clarification on baseline configurations. GameFormer and PLUTO are reported in their “without refinement” versions. Could you explain why these variants were chosen instead of the full published models? If available, results for the full versions would also help assess the fairness of the comparison.
-
Clarification on sensitivity to inference settings. The memory refresh schedule and candidate budget appear to be fixed design choices. Have you tested different refresh frequencies or different numbers/compositions of trajectory candidates? It would be useful to know how sensitive the final performance is to these settings.
-
Clarification on the robustness of nuPlan-CIP results. The conflict-removing arm contains only 21 valid scenes, which is much smaller than the other intervention groups. Could you provide any uncertainty estimates, confidence intervals, or robustness checks to show that the observed trends are stable despite the limited sample size?
Response to Reviewer jJd8
We thank the reviewer for the thoughtful comments. We have strengthened the evaluation of interaction robustness, clarified the role of counterfactual consequences in trajectory generation, reconstructed nuPlan-CIP with complete paired intervention groups, and added sensitivity studies of the memory-refresh schedule and candidate-trajectory budget.
W1. Reactive-agent robustness. Thank you for highlighting the dependence on reactive agents. We added a SMART evaluation following Hagedorn et al., replacing IDM with learned SMART traffic agents while keeping the trained FlowPlan model unchanged. FlowPlan scores 85.81 on Val14-SR versus 87.22 with IDM, a drop of 1.41 points. These results support its robustness across different traffic policies. Appendix C.9 (Table 10) reports this evaluation alongside published IDM/SMART reference results.
W2. Interaction-space coverage. Thank you for raising the coverage concern. The nine intention probes construct consequence memories; they are not the final executable trajectories. FlowPlan generates continuous trajectories from Gaussian noise through its learned flow field. The default pool includes nine intention-associated and six free-motion candidates, allowing trajectories beyond the predefined probes. Section 3.3 and Appendix A.5 clarify this distinction. We also added candidate-budget sensitivity in Appendix C.8 (Table 9) and rebuilt nuPlan-CIP with complete paired groups, as detailed below.
Q1. Counterfactual formulation. Thank you for raising this connection. Tang et al. (2022) use interventional modeling to avoid predictions that assume surrounding agents already know the ego's full future plan. CF-ICM instead learns interaction consequences from executed alternatives: from the same observed scene, we execute different ego trajectories in reactive simulation and record their consequences as other agents respond. Here, "counterfactual" asks what would happen if the ego took an action absent from the original log. CF-ICM predicts object- and time-resolved free-clearance, near-gap, and contact outcomes. During planning, differences in these predicted consequences guide trajectory generation through strategy conditions and consequence memories. We were inspired by Tang et al.'s distinction between observing an ego future and executing an action, and acknowledge this in Section 2.1. Sections 3.2–3.3 and Appendix A.4 describe our formulation and supervision.
Q2. Baseline configurations. Thank you for raising the question of baseline fairness. We compare learning-based planning without additional rule-based refinement or external trajectory optimization, following previous studies, including Diffusion Planner (ICLR 2025) and Diffusion Forcing Planner (CVPR 2026). Full GameFormer adds nonlinear trajectory optimization; full PLUTO adds simulation-based, rule-driven candidate evaluation and selection. We use their published without-refinement variants for consistency with these comparisons. FlowPlan incorporates learned consequences into generation and subsequently selects completed candidates, without an external optimizer modifying their geometry. Section 4.1 specifies the baseline variants.
Q3. Inference sensitivity. Thank you for suggesting these studies. We added both memory-refresh and candidate-budget sensitivity on Val14-R. With the same trained model, eight flow steps, and 15 candidates, fixed memory scores 86.86; refreshing after steps 2, 4, and 6 gives 87.05, 87.22, and 87.13. The default refresh after step 4 gains 0.36 points over fixed memory. All refresh settings share the final candidate-selection procedure; only the timing of memory updates changes. This isolates the contribution of refreshing consequence memory during generation. Candidate budgets of 6, 9, 15, and 24 score 86.69, 87.12, 87.22, and 87.23, respectively. Moving from 6 to the default 15 candidates gains 0.53 points; increasing from 15 to 24 adds 0.01 points. Appendix C.8 (Tables 8 and 9) reports both studies. Section 4.4 summarizes the refresh result, and Appendix A.5 details the default configuration.
Q4. nuPlan-CIP robustness. Thank you for identifying the small intervention subsets. We rebuilt nuPlan-CIP as 140 complete four-world groups across all 14 scenario categories: native, conflict-increasing, conflict-reducing, and irrelevant-actor control. This gives 560 matched instances. The conflict-reducing arm now contains 140 scenarios rather than 21, and every intervention is paired with its own native scene. FlowPlan has the smallest conflict-increasing score drop: 1.14 points, compared with 2.05 for Physics extrapolation and 5.13 for Scene-only. It gains 0.77 points under conflict-reducing interventions, preserves its score under irrelevant-actor changes, and achieves the highest CIR-Gap of 0.79. Section 4.5 (Table 4) and Appendices C.1 and C.5 (Table 6) present the reconstruction and paired results.