- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposed EvolvingNav, an navigation model which focuses on moving targets. The paper predicts the expected position of the moving targets, and deploys the navigation strategy accordingly.
Critical strengths
The research topic is interesting and important. The experiment is sufficient and comprehensive.
Critical weaknesses
The idea of this paper is interesting, and the experiments are fairly comprehensive. However, I think the performance gain of the proposed model could be analyzed more. EvolvingNav combines a structured temporal predictor, an arrival-time forecasting, a belief propagation, etc. The current ablations mainly remove broader modules and do not isolate these designs. More ablation studies that verify the effectiveness of these temporal components to be included would be better. For example, it would be useful to compare arrival time forecasting with only current-state prediction, learned belief propagation with a simple Markov model, and the full method with a version that does not reopen previously inspected locations.
Besides, most results are reported on EvoWorld-Bench, where object movements are generated using predefined household rules. Moreover, the temporal split uses different days from the same household histories for training and testing. Therefore, the model may learn patterns specific to the benchmark generator or individual households. Evaluation on unseen households or different transition rules would provide stronger evidence for generalization. (Though I haven't check whether there is more moving-object navigation benchmark)
Questions for authors
See weakness.
Thank you for your thorough and transparent responses to Q1-Q3. My main concerns are addressed and the VLM latency tests show that live deployment is possible while the added ablations and other additions make the paper much stronger. I am raising my score to accept