- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
InfiniteVLN aims to reduce memory usage and decision latency in streaming vision-language navigation. It separates observation updates from action decisions and uses a local visual cache together with a fixed-size recurrent memory. The memory is controlled by instruction attention. Its 2B model achieves 65.1% SR and 59.3% SPL on R2R-CE, with a peak GPU memory usage of 5.5 GB. On the constructed long-trajectory dataset, ACC+IGRM achieves 50.1% SR, compared to 41.6% with ACC alone. The method is well designed, but the long-trajectory evaluation protocol is not fully clear, and the real-world robot experiments are still limited.
Critical strengths
The main strength of InfiniteVLN is its focus on efficient streaming navigation. The method provides a practical way to control memory usage while maintaining strong navigation performance. I find the following two aspects particularly convincing.
1.InfiniteVLN has a strong performance in a low usage. It achieves competitive results on R2R-CE and RxR-CE among RGB-only VLM methods, with only 5.5 GB of peak GPU memory usage.
2.InfiniteVLN has a effective long-term memory design. When using IGRM, ACC achieves an SR of 50.1, compared to 41.6 without it, while keeping the same peak GPU memory usage. It also outperforms the full-attention baseline, showing the benefit of the proposed memory design.
Critical weaknesses
I think the main weakness of this paper is the lack of validation beyond standard benchmarks. The long-trajectory and robot experiments are still limited, making it difficult to assess the robustness and actual inference speed of the method in real-world settings.
1.The long-trajectory dataset lacks basic statistics, such as dataset size and trajectory lengths. The robot experiments also lack quantitative results on success rates and inference speed.
2.IGRM improves SR by 8.5 points, but the instruction-based gate only outperforms the best fixed gate by 0.9 points, without any uncertainty estimates. Also, comparing memory usage across models of different sizes makes the efficiency gains less convincing.
Questions for authors
I have a few questions that could help clarify my concerns and affect my overall assessment of the paper.
1.The long-trajectory evaluation lacks some important details. Could the authors provide more information to support the reliability of these results?
2.Although instruction-based gating improves performance, the gain over simpler methods is quite small. How much does instruction information actually contribute to the improvement?
3.More quantitative results from real-world robot experiments would make the evaluation more convincing. Is there any additional evidence on navigation success rates and inference efficiency?
6 comments
W3. IGRM improves SR by 8.5 points, but the instruction-based gate only outperforms the best fixed gate by 0.9 points, without any uncertainty estimates. Also, comparing memory usage across models of different sizes makes the efficiency gains less convincing.
Thank you for pointing out that the performance gain of the instruction-conditioned gating mechanism over fixed gating strategies is relatively modest. We agree that it is important to distinguish between the overall contribution of the IGRM module and the incremental contribution of instruction information to the gating mechanism. To further isolate the contribution of instruction information to memory updates, we have conducted additional ablation experiments with different values of α. Specifically, when α = 0, the gating mechanism relies exclusively on the content representations of visual tokens. When α = 1, an instruction-attention term with a fixed weight is incorporated. The full RAG variant, in contrast, employs relative attention mass to achieve adaptive gating.
Ablation results of different gating configurations.
| IGRM | Param | NE↓ | OS↑ | SR↑ |
|---|---|---|---|---|
| - | 5.65 | 47.2 | 41.6 | |
| 5.03 | 54.7 | 49.1 | ||
| 5.26 | 53.1 | 47.5 | ||
| RAG | 4.93 | 55.8 | 50.1 |
The results suggest that simply introducing a fixed-weight instruction-attention term does not consistently improve memory gating. In contrast, the full RAG mechanism achieves the best performance, indicating that adaptively incorporating instruction-related information through relative attention mass is more effective than using a fixed-weight formulation. Moreover, the overall 8.5-percentage-point improvement brought by IGRM cannot be attributed solely to the instruction-attention term. Instead, the primary benefit comes from the long-term recurrent memory and selective memory update mechanisms, while instruction attention provides additional task-relevance constraints that enable the model to selectively preserve historical visual evidence essential for navigation.
Regarding the efficiency comparison, the backbone models used in the existing comparisons are all based on the Qwen architecture, which helps mitigate the influence of architectural differences. Furthermore, we have added a comparison with StreamVLN-2B using Qwen3.5-2B as its backbone. Both methods are deployed on the same edge computing platform (Jetson Orin) and evaluated using FP16 inference precision. The results demonstrate that, with the same backbone model, InfiniteVLN consistently outperforms StreamVLN-2B in both navigation performance and inference efficiency. In contrast, StreamVLN-7B requires a remote server for inference and therefore cannot be deployed directly on the edge device.
Comparison of memory consumption and inference latency on the RxR dataset.
| Method | NE↓ | OS↑ | SR↑ | Mem↓ | Latency/ Sample (s)↓ |
|---|---|---|---|---|---|
| StreamVLN-7B | 6.22 | 52.9 | 46.0 | 19G | |
| StreamVLN-2B | 7.59 | 40.5 | 32.3 | 6.2G | 35.2 |
| InfiniteVLN-2B | 4.32 | 67.8 | 55.6 | 5.5G | 25.8 |
Q1. The long-trajectory evaluation lacks some important details. Could the authors provide more information to support the reliability of these results?
As detailed in our response to W2, the long-trajectory evaluation set contains 536 trajectories, with a mean path length of 23 m and a maximum of 37 m. We used Habitat-Sim’s navigation mesh to verify that the connecting segments were traversable and manually checked that the merged instructions preserved key landmarks, turn sequences, and goal constraints from both original segments and were consistent with the reference paths.
Q2. Although instruction-based gating improves performance, the gain over simpler methods is quite small. How much does instruction information actually contribute to the improvement?
We further isolate the actual contribution of instruction information through the newly added α ablation experiments. The results indicate that instruction information provides additional task-relevance constraints for long-term memory updates, thereby improving the selective retention of historical evidence. Although the incremental performance gain is relatively modest, it demonstrates the additional benefits of instruction-conditioned gating over strategies that rely solely on content representations or fixed memory-writing ratios. Meanwhile, we would like to emphasize that the primary contribution of IGRM comes from the long-term recurrent memory mechanism itself, which improves SR by 8.5 percentage points compared with the ACC-only baseline. Instruction information further enhances this memory update process by providing task-specific guidance for retaining navigation-relevant historical evidence.
Q3. More quantitative results from real-world robot experiments would make the evaluation more convincing. Is there any additional evidence on navigation success rates and inference efficiency?
As detailed in our response to W1, we conducted 70 real-world trials using the Unitree Go2 and G1. InfiniteVLN succeeded in 30 of 35 indoor trials (85.7%) and 28 of 35 outdoor trials (80.0%). Inference ran entirely onboard an NVIDIA Jetson Orin, with a latency of approximately 1.2 s per step and no reliance on a remote server.
We thank the reviewer for the constructive feedback and for recognizing InfiniteVLN’s strong navigation performance and low memory usage. We address each concern below.
We conducted a total of 70 real-world trials across unseen complex indoor and dynamic outdoor environments, and validated our method on both the Unitree Go2 quadruped robot and the Unitree G1 humanoid robot. Inference ran locally on an NVIDIA Jetson Orin without a remote server, with a latency of approximately 1.2 s per step.
Quantitative results of real-world experiments.
In indoor environments, the navigation distances ranged from 10 to 30 m, with a success rate of 85.7% (30 successful trials and 5 failures). The failure cases were primarily associated with highly reflective materials, such as glass and ceramic tiles. These materials can introduce unstable visual observations, increasing the risk of incorrect scene interpretation and navigation hallucinations.In outdoor environments, the maximum successful navigation distance reached approximately 60 meters, with a success rate of 80% (28 successful trials and 7 failures). Compared with indoor environments, outdoor navigation involves more complex environmental variations, among which illumination conditions are a major factor affecting navigation stability. For example, under strong sunlight, significant glare may appear in camera images, resulting in the loss of critical visual evidence and consequently affecting navigation decisions.
We believe that these failure cases reveal some of the remaining limitations of current sim-to-real generalization approaches. Specifically, training data collected in simulated environments cannot fully reproduce the complex illumination variations and material reflectance encountered in real-world environments.
The long-trajectory evaluation set contains 536 trajectories, with an average path length of 23 meters and a maximum path length of 37 meters. For concatenated trajectories, we first use the navigation mesh in Habitat-Sim to verify the traversability of the connecting segments. We then conduct manual verification to ensure that the merged instructions preserve the key landmarks, turning sequences, and goal constraints from both original trajectory segments. We also verify that the descriptions of the connecting segments are consistent with the corresponding reference paths.
Regarding the quantitative evaluation of real-world performance, we have provided detailed results on navigation success rates and inference latency in our response to W1.