- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes GeoStruct-VO, a hybrid monocular visual odometry pipeline that combines learned motion predictions with selectively applied two-view geometry. Its depth and pose networks are trained jointly through self-supervised view reconstruction, while SAFE modifies the shallow RGB feature encoder to enhance motion-relevant structural responses. At inference time, SPGR applies rule-based reliability checks to selectively replace the network predicted rotation and translation direction while retaining the predicted translation norm. A sliding window module, MRG, estimates rotational corrections from cross-frame constraints and updates trajectory positions accordingly. Experiments on KITTI sequences 09–10 and two vKITTI2 scenes under three conditions report lower average odometry errors than the evaluated learning-based baselines. The vKITTI2 evaluation uses KITTI-trained models without fine-tuning or test-time adaptation.
Critical strengths
- On KITTI sequences 09–10, the full pipeline achieves average translational and rotational errors of 2.93% and 0.46°/100 m, respectively, outperforming the learning-based baselines included in the main comparison.
- KITTI-trained models are evaluated on two vKITTI2 scenes under three appearance conditions without fine-tuning or test-time parameter updates. The full pipeline obtains the lowest average ATE, translational error, and rotational error among the methods evaluated in this setting.
- Removing SAFE increases translational error, removing SPGR increases both translational and rotational errors, and removing MRG also degrades the aggregate results. These experiments support the practical usefulness of the components within the proposed system.
- The configuration without MRG achieves a reported front-end latency of 20.9 ms/frame while retaining competitive accuracy on the reported hardware.
Critical weaknesses
Major Weaknesses
- Although the paper motivates its contribution relative to hybrid systems such as DROID-SLAM, DPVO, and DF-VO, these methods are absent from the main comparison. DF-VO appears only in a supplementary evaluation under a different protocol. Furthermore, the MRG ablation only considers removing the back end, without comparing against established alternatives such as rotation-graph optimization, pose-graph optimization (e.g., ORB-SLAM), bundle adjustment (e.g., ORB-SLAM2 and DROID-SLAM), or even local bundle adjustment. Since the benefits of geometric refinement have already been well established in prior work, the current experiments merely confirms the usefulness of adding geometric optimization, rather than demonstrating any specific advantage of MRG. Therefore, it remains unclear what MRG offers beyond conventional geometric optimization methods. I know inference time is a trade-off, but these conventional refinements are needed to build the contribution.
- The component ablation supports the usefulness of SAFE within the complete pipeline, but does not establish that its improvement specifically results from preserving motion-relevant structural cues. There are no parameter- or computation-matched controls, targeted ablations of its constituent operations, or comparisons that reduce or delay downsampling. Figure 4 shows changes in feature responses and channel participation, but these observations do not establish structural preservation or motion relevance. The current evidence therefore does not distinguish the proposed mechanism from alternative explanations such as increased model capacity or more general feature enhancement.
- The connection between the stated problems and several design choices remains unclear. The paper motivates SAFE through boundary-related cues and the possible loss of subtle responses during early downsampling, but does not clearly establish which structural information is missing or explain how its particular filtering, aggregation, and downsampling operations address that loss. Since the filters are unconstrained and receive no explicit structural supervision, their learnability alone does not establish the intended structural interpretation. Section 3 also asserts complementarity between RGB and predicted disparity without adequately explaining the expected benefit of channel exchange. In the introduction, MRG is introduced without adequately connecting it to the preceding motivation. Although Section 3.3 later identifies residual rotational drift as its target, the rationale for choosing this particular correction formulation remains insufficiently developed. These gaps make it difficult to identify the specific hypotheses underlying the proposed components and assess whether the experiments test them.
Minor Weaknesses
- The paper does not specify how the MRG confidence weight is obtained, sufficiently detail the operations represented by and , or define the spatial CV and normalized effective-channel statistics. These omissions limit reproducibility and interpretation.
- Figure 1(c) does not clearly distinguish the configurations and timing definitions associated with 20.9 and 31.4 ms/frame. Figure 2 mixes architectural details, training objectives, and inference stages, while omitting intermediate feature labels needed to connect it to the equations. The dense-mapping panels in Figure 3 lack sufficient explanation of their construction, visual elements, and intended takeaway. Figure 4 similarly requires a clear description of feature aggregation and normalization for meaningful visual comparison.
- Preserving the network-predicted translation norm does not by itself establish recovery of metric translation magnitude, which makes the contribution statement stronger than the described setup supports. The paper should clarify this wording, specify whether trajectory alignment includes scale fitting, and describe the ATE computation and units. It should also explain how translation magnitude is assigned to the Pure Geometry baseline in Figure 5.
Questions for authors
- What advantage does MRG provide over a conventional rotation-graph, pose-graph, or local bundle-adjustment back end attached to the same front end? Can the authors provide a controlled comparison, including the accuracy–runtime trade-off?
- How are “motion-relevant structural cues” operationally defined? Can the authors provide evidence that SAFE preserves these cues, rather than improving performance through additional capacity or computation? A matched-capacity control and a reduced-downsampling comparison would help distinguish these explanations.
- What specific benefit is expected from exchanging RGB and predicted-disparity features, and what evidence isolates this benefit? Can the authors provide an error analysis showing when residual rotational drift remains after SPGR and when MRG successfully reduces it?
- Does trajectory alignment fit a global scale, and how is ATE computed? How is translation magnitude determined for the Pure Geometry baseline in Figure 5? Does “metric translation magnitude” mean that the network predicts translation in physical units before trajectory alignment? If so, what anchors this scale in the described training setup?