- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes CastAD, an ego-centric joint supervision framework for planning-oriented end-to-end autonomous driving. Built on HiP-AD, the method adds a joint prediction branch, uses the ego’s ground-truth spatial trajectory to select interaction-relevant agents, and selects a shared joint mode based on the ego spatial trajectory. Under this mode, the ego and the relevant agents are jointly supervised. A GRPO-based policy optimization stage is then applied on the joint-mode ego embeddings, with rewards based on a PDMS decomposition. Experiments are conducted on Bench2Drive and NAVSIM, reporting closed-loop metrics, driving-ability breakdowns, and ablations.
Critical strengths
-
The motivation is reasonable: marginal supervision can produce interaction-inconsistent futures, while all-actor joint supervision can be dominated by irrelevant agents.
-
The method is relatively complete: Agent-Mode Attention, ego-centric mode selection, interaction-relevant agent selection, and GRPO form a full training pipeline.
-
The experiments are fairly comprehensive: both Bench2Drive closed-loop and NAVSIM are reported, with multi-ability breakdowns and ablations. The ablation suggests that most of the gain comes from ego-centric joint supervision rather than GRPO.
Critical weaknesses
-
Limited novelty / incremental contribution. Joint supervision is not new in motion forecasting; it has been studied in Scene Transformer, M2I, JointMotion, RetroMotion, etc. CastAD essentially changes all-actor winner-takes-all to ego-only mode selection and uses the GT spatial trajectory for collision-based agent filtering. This is close to a simple variant of conditional joint prediction or ego-as-influencer modeling.
-
GRPO is not a new method. GRPO was introduced in DeepSeekMath/R1, and RL or preference optimization has already been used in autonomous driving, e.g., DiffusionDriveV2. This paper mainly applies GRPO to joint-mode ego embeddings, which is an implementation-level change.
-
The SOTA claim is outdated. For example, on Bench2Drive, there are numerous works that achieved far better results (as reference https://github.com/autonomousvision/Bench2Drive-Leaderboard).
-
Key details and inference mechanism are unclear. The Ego-Centric Joint Prediction Head is not used for planning, yet policy optimization is performed on joint-mode embeddings. The masked trajectory distance, collision criterion, and GRPO mode probability definition are not clearly specified.
Questions for authors
-
Limited novelty / incremental contribution. Joint supervision is not new in motion forecasting; it has been studied in Scene Transformer, M2I, JointMotion, RetroMotion, etc. CastAD essentially changes all-actor winner-takes-all to ego-only mode selection and uses the GT spatial trajectory for collision-based agent filtering. This is close to a simple variant of conditional joint prediction or ego-as-influencer modeling.
-
GRPO is not a new method. GRPO was introduced in DeepSeekMath/R1, and RL or preference optimization has already been used in autonomous driving, e.g., DiffusionDriveV2. This paper mainly applies GRPO to joint-mode ego embeddings, which is an implementation-level change.
-
The SOTA claim is outdated. For example, on Bench2Drive, there are numerous works that achieved far better results (as reference https://github.com/autonomousvision/Bench2Drive-Leaderboard).
-
Key details and inference mechanism are unclear. The Ego-Centric Joint Prediction Head is not used for planning, yet policy optimization is performed on joint-mode embeddings. The masked trajectory distance, collision criterion, and GRPO mode probability definition are not clearly specified.