- Rating
- 1(−1)
- Confidence
- 4(+2)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
EgoExo-VLN studies language-guided navigation with onboard observations and fixed external cameras in environments with target relocation and moving pedestrians. The benchmark contains 8,096 episodes across 90 scenes with scene-disjoint splits. The proposed system combines camera relevance, temporal target memory, geometric navigation, and predictive waiting, achieving 55.31% test SR and 53.33% SafeSR on pedestrian-present episodes.
Critical strengths
- The task captures a meaningful limitation of onboard sensing: relevant changes can occur outside the robot’s view. Matched absent, conflict, and non-conflict pedestrian conditions provide a useful basis for studying when external evidence should change an action.
- The ablations provide evidence beyond simply adding cameras. Learned camera relevance raises SR from 41.93% to 54.60%, while target-evidence memory improves SR from 52.00% to 55.31% over current-only observations. These results support selective fusion and temporal memory within the proposed system.
Critical weaknesses
- The comparisons failed to isolate the source of the gains. The full system utilizes external depth, calibrated camera geometry, robot pose, a NavMesh-based follower, and a separate arrival predictor, but Section 5.2 does not specify which inputs and controller components each baseline received. Furthermore, removing external observations also disabled the camera-guided geometric execution in Appendix D, therefore the increase in SR cannot be entirely attributed to visual fusion.
- Appendix B evaluates every STOP against the final location B, including stops before or during transport, without requiring the target to have arrived. Therefore, the episode may be considered successful even if the target is still elsewhere. While this aligns with the final location objective set, it makes it unclear whether the success rate reflects timely target tracking and navigation target updates. The paper does not report the frequency of such early successes, nor does it analyze whether they affect the main conclusions.
Questions for authors
See Weakness
18 comments
Thanks for your time and effort in reviewing this paper. Your comments are valuable to improve the quality of this paper. As the author-reviewer discussion period will end in about 1 day, we gently request that you read the rebuttal and check whether your concerns are addressed. Thanks again for your time and help in improving the quality of this paper.
I thank for the authors' detailed rebuttal. However, I'm still concerned about the baseline comparison and the usage of other camera views. I decide to maintain my score.
Response to Reviewer dCnc
We thank the reviewer for this suggestion. To make the contributions of external visual information and auxiliary execution mechanisms clearer, we have added the following hierarchical ablation study and will clarify the input and controller configurations of each baseline in Section 5.2.
All seven baselines retain their original egocentric observations and core navigation mechanisms, without incorporating the exocentric RGB or other external data used in our method. We will further clarify the specific mechanisms used by each method in Section 5.2.
The ablation results are presented below:
The additional comparisons demonstrate that external RGB still provides clear benefits when the additional geometric execution and Arrival Predictor are disabled. Adding only Camera Metadata changes SR from 17.15% to 17.24%, without showing a consistent performance improvement. With metadata available and both geometric execution and the Arrival Predictor disabled, further introducing external RGB increases SR from 17.24% to 37.68% (+20.44 percentage points). Reloc. SR and SafeSR also increase from 16.58% and 18.75% to 38.78% and 34.39%, respectively. This comparison supports the navigation value of external visual evidence independently of the aforementioned auxiliary execution and termination modules.
On this basis, enabling the NavMesh Follower increases SR from 37.68% to 49.20% (+11.52 percentage points). Further introducing the Arrival Predictor increases SR to 55.31% (+6.11 percentage points). These comparisons also quantify the contributions of geometric execution and arrival prediction to the full system. Regarding depth information, Table 4 of the paper shows that, with egocentric depth retained, SR/SPL are 52.27%/51.46% without exocentric depth, and increase to 55.31%/54.48% when exocentric depth is used. Based on these results, we will revise the relevant descriptions.
We thank the reviewer for the suggestion to examine the timing of STOP decisions. To verify the evaluation results, we individually examined all target-relocation trajectories classified as successful under the original protocol in the Test set, comparing the time when the robot executed STOP with the times when the target started moving and completed its relocation. Among all successful target-relocation trajectories, there were 0 premature successes before the target started moving and 0 during relocation, resulting in an overall occurrence rate of 0%. We further introduced a temporal constraint requiring that the target had completed its relocation and reached location B, and re-evaluated the same trajectories offline. The overall SR and Reloc. SR of our method remained 55.31% and 56.74%, respectively, unchanged from the original results. This check confirms that premature STOP decisions did not inflate the reported success rate of our method.