- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes a framework to determine whether reinforcement learning controllers in metro operations genuinely use live state information, known as the online feedback. The framework comprises four operations: calendar-conditioned reconstruction (P1), counterfactual rollouts from identical simulator states (P2), a comparison of the information sets that predict those counterfactual values (P3), and a power certificate under declared demand perturbations (P4). Experimetns applied method to three metro control examples, Hangzhou, Beijing and Shanghai.
Critical strengths
Extensive experiments on 3 metro systems, including Beijing, Shanghai and Hangzhou. Provide a lot of information for whether the method works or not.
Critical weaknesses
While applying RL algorithms to metro systems sounds new, I find little theoretical contribution in this paper. It looks more or less like an application of PPO to metro system. Few baselines are used, only PPO. Newer baselines can be compared.
I find it is very hard to follow the author's writing. For example, Table 2 and 3 contains too much information, usually the paper should pass the main message to the readers, instead of contain everything they did during experiment. Using tools to help revising texts is fine, but I think it would be better if the author have a clear idea of what message they want to deliver.
Questions for authors
Is it possible to compare with more recnet baselines like GRPO, DAPO? If not, please provide reasoning.