- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes RayCon, a training-free post-optimization framework for long-sequence feed-forward 3D reconstruction. The method decomposes reconstruction errors into transverse and radial components and addresses them through global-to-local optimization. Globally, staggered dual-window inference and trajectory fusion improve camera poses. Locally, Temporal–Range Consistency Filtering (TRCF) removes inconsistent predictions, while Surface-Consensus Refinement (SCR) refines depths using multi-view geometric constraints. Experiments using LingBot-Map as the backbone demonstrate substantial improvements in trajectory accuracy and surface quality on KITTI, Oxford Spires, and 7-Scenes.
While I do not see major issues with the paper's core contributions, the experimental validation remains insufficient. I encourage the authors to provide more comprehensive experiments to strengthen the paper's claims and overall credibility.
Critical strengths
-
The decomposition of reconstruction errors into transverse and radial components provides a clear geometric motivation for the proposed global-to-local optimization framework.
-
RayCon demonstrates promising reconstruction performance across multiple benchmarks without requiring additional training, highlighting its practical effectiveness as a post-optimization framework.
Critical weaknesses
-
All experiments rely on LingBot-Map, providing insufficient evidence of generalizability. Evaluations on other backbones, such as VGGT-Long, are necessary to support broader applicability claims.
-
Equal-weight trajectory fusion lacks reliability estimation, potentially degrading accurate trajectories when one reconstruction fails. Robustness under asymmetric tracking failures remains unexplored.
-
Table 9 evaluates SCR components on a single best-performing region, with most component replacements yielding identical results. Broader ablations are needed to establish their effectiveness.
-
Table 9 introduces component abbreviations that differ from the main text, making the ablation study difficult to interpret without carefully revisiting Section 3.4.
Questions for authors
-
Could the authors evaluate RayCon on other reconstruction backbones, such as VGGT-Long, to demonstrate its generalizability beyond LingBot-Map?
-
How does the proposed equal-weight trajectory fusion handle cases where one reconstruction suffers from severe tracking failures while the other remains accurate?
-
Could the authors provide broader ablation studies across multiple regions to clarify the effectiveness of individual SCR components, given that most replacements yield identical results? Additionally, could the authors clarify the correspondence between the component abbreviations in Table 9 and the terminology used in Section 3.4?
5 comments
W3 & Q3: SCR effectiveness and identical ablation results.
A: Our post-optimization primarily aims to eliminate surface ghosting and layered artifacts introduced by multi-window reconstruction.
Global and local geometry improvements. In full-scene reconstruction, point-cloud quality and camera poses are strongly coupled. With our global optimization, the mean CD across all 11 KITTI sequences decreases from 9.0131 m to 2.4973 m, a 72.29% reduction, as shown in Table 4.
Local refinement. SCR applies only centimeter-scale corrections along viewing rays to ghosted points, leaving other points unchanged. Consequently, the mean CD across eight regions decreases only from 0.0973 m to 0.0938 m. However, in a representative ghosting region, F1@10 cm increases from 9.49% to 22.32%, as shown in Table 3. Such subtle point-cloud misalignments have limited impact on overall CD but directly cause visible surface layering and ghosting, making these improvements difficult to quantify. Figures 1, 3, and 4 visually demonstrate substantial removal of these artifacts. This shows that SCR specifically targets local ghosting that affects reconstruction quality.
Identical SCR ablation results. H determines the target surface, whereas D, J, and M constrain admissible corrections. Since the inferred depth adjustments already fall within these constraints, removing them produces nearly identical results in the evaluated region.
Table 3: Local Surface Deghosting Evaluation with Fixed Cameras
| Evaluation Setting | CD ↓ (m) | F1@10 cm ↑ |
|---|---|---|
| 7-Scenes Heads, All 8 Regions | 0.0973 → 0.0938 | 43.40% → 45.61% |
| Table 9 Representative Ghosting Region | 0.1531 → 0.1319 | 9.49% → 22.32% |
| Table 9 Representative Region: Effect of H | 0.1339 → 0.1319 | 20.32% → 22.32% |
Table 4: Global Dense Point-Cloud Evaluation with Joint Pose and Geometry Optimization on KITTI
| Metric / Evaluation Scope | Base Integration | Ours | Improvement |
|---|---|---|---|
| Mean CD ↓, All 11 Sequences (m) | 9.0131 | 2.4973 | −72.29% |
| Mean F1@10 cm ↑, All 11 Sequences | 4.48% | 6.52% | +2.04 pp |
| CD ↓, KITTI 01 (m) | 60.9646 | 4.1960 | −93.12% |
| CD ↓, KITTI 02 (m) | 12.9471 | 6.5902 | −49.10% |
| CD ↓, KITTI 08 (m) | 6.0440 | 2.4740 | −59.07% |
| CD ↓, KITTI 10 (m) | 4.0236 | 1.9747 | −50.92% |
| CD ↓, KITTI 04 (m) | 5.0340 | 3.0126 | −40.16% |
Q3: What do the component abbreviations in Table 9 represent, and how do they correspond to Section 3.4?
A: We will use consistent component names in Section 3.4 and Table 9: D — Directional Bounds, which constrain allowable geometric errors; J — Joint Track Compatibility, which enforces multi-view consistency within each track; H — Held-out Track Scoring, which selects the correct target surface; and M — Minimum Ray-Depth Change, which minimizes unnecessary point movements. We will also improve the method flowchart to clearly illustrate the surface selection and depth correction process.
As the discussion period is coming to an end, we would appreciate it if the reviewers could take a moment to review our rebuttal and additional experiments, and share any remaining concerns. We welcome further discussion and hope the new evidence can be considered in the final evaluation.
We thank the reviewer for recognizing the geometric motivation behind our tangential–radial error decomposition and the effectiveness of RayCon in improving long-sequence reconstruction without retraining. We provide additional analyses and experiments addressing cross-backbone generalization, the reliability of equal-weight fusion, and SCR ablations.
A: To eliminate the influence of backbone differences, we conduct controlled same-backbone comparisons on all 11 KITTI sequences (00–10).
These controlled experiments demonstrate that RayCon's improvements do not simply result from using a stronger backbone. Our global-to-local post-optimization consistently reduces mean trajectory error by 20.8%–57.3% across different visual geometry backbones.
Table 1: Cross-Backbone Evaluation on KITTI 00–10 (ATE ↓, m)
A: Our dual-window fusion exploits complementary errors between staggered window partitions, reducing mean ATE from 11.074 m to 9.588 m across KITTI under normal conditions.
To examine asymmetric branch failures, we conduct two perturbation tests on KITTI 07. Under moderate perturbation, the affected branch obtains 9.825 m ATE, while fusion achieves 4.955 m, close to the intact branch (4.744 m). Under severe corruption, the affected branch degrades to 58.851 m, and fusion reaches 26.796 m.
Table 2: Dual-Window Fusion Under Asymmetric Branch Perturbations (KITTI 07)
These results demonstrate that dual-window fusion effectively exploits complementary estimates under moderate perturbations, while severe single-branch failures can propagate into the fused trajectory.