- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces a new rl-based post-training method for traffic simulation to reduce collision. Tthe paper proposes aligned agent-time group-relative credit assignment. Rather than computing one scalar reward per rollout and broadcasting its advantage to every token, physical rewards are maintained at agent-step resolution and normalized across same-scenario rollouts at each aligned position. On WOMD with SMART-7M, the three-seed mean collision rate decreases from 3.394% for uniformly sampled refined RL to 2.914% for Dense RL, with ADE increasing only slightly from 2.0805 m to 2.1055 m.
Critical strengths
- The code is provided.
- The video is clear.
- The writing is good and easy to follow.
Critical weaknesses
- The primary comparison is against a rather weak RL baseline. Published traffic post-training methods such as SMART-R1, RLFTSim, R1Sim are not directly evaluated under the same CR/OR/ADE protocol.
- The improved metrics are limited to collision and ADE. The method substantially degrades overall WOSAC realism relative to the pretrained SMART model. Reducing only collision and ADE is not hard in traffic simulation. It can lead to wired behavior such as off-road or slow driving.
- Important related works are missing. The paper should discuss spatial-temporal credit decomposition methods such as STAS (Spatial-Temporal Return Decomposition for Solving Sparse Rewards Problems in MARL), as well as traffic-specific post-training approaches including DecompGAIL and multi-agent AIRL for intersection simulation.
Questions for authors
- How accurately does the physical mask approximate the theoretical informative-state set? Is there any empirical relation between mask membership and action-sensitive return variance?
- How much overlap exists between the collision-mined scene sets across consecutive epochs?
- Can the authors test multiple probe rollouts per scenario and report the stability of collision-based scene labels?