My main concerns are the insufficient discussion of related work, the unclear justification for the problem settings and methodological choices, and the limited experimental evidence supporting these choices and the method’s generalizability.
Major concerns
-
Insufficient literature review. Reinforcement learning for UAVs and pursuit–evasion (PE) [1–3] is an active research area. The paper cites only 12 references and does not sufficiently discuss relevant recent developments. The literature review is insufficient to provide a comprehensive overview of the relevant research, leaving the novelty and significance of the claimed contributions unclear.
-
Insufficient justification of the problem formulation. The authors do not clearly justify the adopted settings or explain how they inform the proposed method. For example, the kinematic model closely resembles the Dubins car model [4], but the authors provide neither a citation for this modeling choice nor a justification of its suitability for the UAVs considered. Given that “multi-UAV” appears in the title, the authors should explain how these modeling assumptions reflect the intended multi-UAV application.
-
Insufficient motivation for the method. The authors clearly describe their method, but the reasons for several design choices remain unclear. For example, Section 3.2 describes an LSTM-based decoder without explaining why this architecture was chosen over other trajectory-prediction approaches.
-
Insufficient experimental details. Although the paper reports a training and evaluation protocol and a hyperparameter table, the authors should clarify the training configurations of the individual baseline methods, particularly whether their hyperparameters were tuned for this task. Deep reinforcement learning can be sensitive to hyperparameters [5,6]. FACMAC appears to perform poorly, and the authors should explain these results. I think its poor performance may be related to hyperparameter settings or implementation issues.
-
Insufficient ablation studies. Section 4.3 states that “w/o LSTM removes multi-step trajectory prediction,” with the corresponding results shown in Figure 4. This comparison demonstrates the benefit of including trajectory prediction, but it does not isolate the contribution of the LSTM architecture. The justification for adopting LSTM specifically therefore remains unclear.
Minor concerns
-
The authors state that “The predictor is trained separately from PPO using simulator-generated history–future pairs.” The pursuers’ policies change during training, and the evader’s behavior depends on the pursuers’ actions. The trajectory distribution may therefore shift as training progresses. How does the predictor handle these distribution shifts? The authors should clarify how the prediction data and predictor are updated and report quantitative metrics evaluating prediction accuracy and reliability.
-
The experiments use static obstacles and a single type of evader policy. Simple heuristics may also perform well under these settings, and the authors should include such methods as baselines. The authors should also consider more dynamic scenarios and a broader range of evader policies to evaluate the generalizability of the proposed method.
-
Missing AI use statement. According to the ICLR 2027 Author Guidelines, an AI use statement is required rather than optional. I could not find such a statement in the manuscript.
References
[1] C. de Souza, R. Newbury, A. Cosgun, P. Castillo, B. Vidolov, and D. Kulić. “Decentralized Multi-Agent Pursuit Using Deep Reinforcement Learning.” IEEE Robotics and Automation Letters, 6(3):4552–4559, 2021. DOI: 10.1109/LRA.2021.3068952.
[2] Y. Xiang, S. Li, R. Li, Z. Zhao, and H. Zhang. “Decentralized Consensus Inference-Based Hierarchical Reinforcement Learning for Multiconstrained UAV Pursuit-Evasion Game.” IEEE Transactions on Neural Networks and Learning Systems, 36(10):18229–18243, 2025. DOI: 10.1109/TNNLS.2025.3582909.
[3] Y. Liu, C. Liu, Y. Meng, B. Jiang, and X. Wang. “Observer-Based Multi-Agent Reinforcement Learning for Pursuit-Evasion Game With Multiple Unknown Uncertainties.” IEEE Transactions on Automation Science and Engineering, 22:14332–14345, 2025. DOI: 10.1109/TASE.2025.3560757.
[4] L. E. Dubins. “On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents.” American Journal of Mathematics, 79(3):497–516, 1957. DOI: 10.2307/2372560.
[5] P. Henderson, R. Islam, P. Bachman, J. Pineau, D. Precup, and D. Meger. “Deep Reinforcement Learning That Matters.” Proceedings of the AAAI Conference on Artificial Intelligence, 32(1):3207–3214, 2018. DOI: 10.1609/aaai.v32i1.11694.
[6] T. Eimer, M. Lindauer, and R. Raileanu. “Hyperparameters in Reinforcement Learning and How To Tune Them.” Proceedings of the 40th International Conference on Machine Learning, PMLR 202:9104–9149, 2023.