- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NavCompose, a self-supervised framework that learns composable and continuous visual transition representations from unlabeled trajectories for image-goal navigation. It combines three training objectives: pairwise transition grounding via view reconstruction, compositional regularization for consecutive viewpoint changes, and continuity regularization for latent interpolation and short-horizon extrapolation. The learned transition encoder is then frozen, and a lightweight waypoint prediction head is trained on labeled navigation trajectories. Across four navigation benchmarks—Go Stanford, RECON, SACSoN, and SCAND—NavCompose improves waypoint prediction accuracy over existing navigation and representation-learning baselines. The authors also report favorable label efficiency and inference speed, along with qualitative interpolation/extrapolation results and real-world robot navigation experiments.
Critical strengths
-
A well-motivated representation-learning formulation for visual navigation. The paper tackles an important question: how to learn navigation-relevant representations from unlabeled visual trajectories instead of relying mainly on action or waypoint supervision.
-
Strong downstream performance and computational efficiency. The experimental results are encouraging across multiple navigation benchmarks. NavCompose achieves the best average ATE/RPE among the compared methods (0.499/0.133), while keeping the downstream architecture lightweight.
Critical weaknesses
1.There is not yet enough evidence that the learned transition space is geometrically consistent and genuinely compositional.
Although the composition and continuity objectives do encourage structure, the learned representation may still entangle appearance or scene content with viewpoint motion. In particular, the composition operation combines latent addition with a learned residual correction, but it lacks an explicit disentanglement mechanism or group-theoretic constraint that would ensure pose-consistent composition across different scenes and trajectories. As a result, it remains unclear whether the learned algebra captures transferable geometric transformations or mainly reflects trajectory-specific visual correlations.
- Real-world evaluation is limited, and practical robustness is not yet well established.
The real-world experiments cover four routes with only three trials per method per route, amounting to 12 trials per method. Although NavCompose achieves a promising 75% success rate, the small number of trials makes it hard to judge the statistical reliability of the observed improvements. In addition, all methods rely on route-specific topological maps and a shared downstream navigation stack, which limits how much the results demonstrate robustness in less structured or previously unseen environments.
Questions for authors
Q1. Geometric consistency and disentanglement (Clarification).
To what extent does the learned transition latent encode relative viewpoint motion independently of scene appearance and content? Since the composition operator includes a learned residual correction, what prevents it from learning scene-dependent transformations that do not generalize consistently across trajectories? Can the authors provide evidence of geometric consistency, such as cross-scene transition transfer, inverse consistency, or cycle consistency?
Q2: Reliability of real-world navigation results (Clarification and additional evidence).
Given that the real-world evaluation includes only three trials per route and uses route-specific topological maps, how sensitive are the reported success rates to trial variability and environmental conditions? Can the authors provide additional trials, uncertainty estimates, or results on previously unseen routes to better substantiate the practical robustness of NavCompose?
3 comments
Thank you for addressing my concerns! I will keep my positive score.
We sincerely thank the reviewer for the constructive discussion and positive assessment, which have helped us improve the paper.
## Reviewer JKDj
We thank the reviewer for the insightful feedback. We have revised the paper accordingly.
W1 / Q1. Geometric consistency and disentanglement of the transition latent. We added an analysis in Appendix A.1 (Table 8). On held-out scenes from RECON and ScanNet, we test three properties, none of which is used as a training objective:
Results (PSNR in dB, higher is better; Appendix A.1, Table 8):
Although none of the three properties is used as a training objective, all of them emerge in the learned latent. These results indicate that the latent encodes motion largely independently of scene content. Regarding the residual correction: the cycle test above uses the full composition ⊕ including fϕ, and closed loops still render closer to the start view than open chains or randomly closed loops, suggesting that the residual preserves rather than breaks the geometric consistency of the latent. This is also encouraged by design: fϕ operates only on latents, and the renderer already receives the scene appearance from the source image, so the latent only needs to carry the motion.
W2 / Q2. Reliability of the real-world results. We extended the evaluation from 4 routes × 3 trials to 6 routes × 10 trials per method (Section 4.6, Table 7). NavCompose achieves an overall success rate of 80.0% (48/60), compared with 41.7% (25/60) for ViNT and 11.7% (7/60) for NoMaD, and achieves the highest success rate on every route (per-route results in the General Response). A trial counts as a success only if the robot reaches the physical goal region and stops within it without collision or human intervention.
Robustness to environmental conditions. To test sensitivity to environmental changes, we repeated the Office route under three perturbations that are absent when the topological map is recorded (new Appendix A.5, Figure. 9): (1) minor layout changes, where objects along the route are moved or added; (2) dynamic obstacles, where a pedestrian walks through the camera view; and (3) extreme lighting, where strong direct sunlight causes overexposure and hard shadows. The topological map, goal images and all model parameters are kept unchanged, so observations during execution can differ substantially in appearance from the stored subgoal images. In this rollout, NavCompose still reaches and stops within the goal region. This suggests that the learned transition representation captures viewpoint changes between observations rather than relying on exact appearance matching.
Route-specific topological maps and unseen routes. Following ViNT and NoMaD, we evaluate image-goal navigation, where the target is specified by images rather than coordinates. Goal images must therefore be collected beforehand: for each route, we teleoperate the robot once to record a visual trajectory and sample it into a topological map of goal images (Appendix A.4). This one-time recording only defines the goals; it is not used for training, and no model parameters are updated using observations from the evaluation routes. All three methods share the same map, node-selection procedure, goal-switching rule, and low-level controller, so the comparison isolates the navigation model.