- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes TCO, which constructs an intersection’s reward from the subsequent queueing costs of vehicles currently observed there. Vehicle identities determine whose costs are included, while temporal and intersection-hop limits bound the trajectory window. Rewards are computed retrospectively and used with existing learners. Experiments report improvements across three controllers and eight traffic settings.
Critical strengths
1.Table 1 uses ten seeds and reports improvements in all 24 controller–scenario combinations. The paired-run results make this stronger than a comparison of means alone. 2.The method is simple, and the reward-scaling control and partial-coverage experiments address useful practical questions.
Critical weaknesses
- The trajectory-based rewards depend on subsequent actions, while the training procedure on page 5 retains the original TD/PPO updates. Please clarify the training objective and how these updates relate to the objective defined in Eq. (6).
- Table 6 reports lower ATT for K=3 than K=0 in seven of eight settings, but does not specify seed counts or uncertainty estimates. Reporting paired ATT differences across seeds, with confidence intervals, would help assess whether these gains are consistent across runs.
- As stated in Appendix A.2, training and evaluation use the same traffic flow file. Evaluation on independently generated arrival patterns or routes is not reported, leaving generalization to unseen traffic realizations unclear.
Questions for authors
- Could you clarify how the TD targets and PPO advantages are computed with TCO rewards, and how these updates relate to the objective in Eq. (6)?
- How many seeds were used for Table 6? Could you report the paired ATT differences between K=0 and K=3, and check whether the gains persist under the main H=24 setting?
- Do TCO’s gains persist when the trained models are evaluated on independently generated traffic flows with the same demand level but different arrival times or routes?