- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RAGR, a post-prediction refinement framework for multi-view 3D reconstruction. Starting from a frozen FastVGGT prediction, it constructs co-visible spatial groups and routes each group to either retain the original depth or apply one of three lightweight, teacher-derived residual corrections. The correction modules and router are trained exclusively on source-domain data and evaluated zero-shot on ETH3D and Tanks and Temples. RAGR improves over the initial prediction on ETH3D but does not improve AbsRel on TNT. Additional analyses demonstrate regional action complementarity while revealing limitations in cross-domain routing and alignment between local supervision and scene-level evaluation.
Critical strengths
1. Effective teacher-derived corrections. The fixed VGGT-derived correction reduces ETH3D AbsRel from 0.43949 to 0.40507 without requiring teacher execution at inference, demonstrating the practical value of lightweight residual proxies (Table 1).
2. Relevant controls and transparent reporting. Fixed-action baselines, a matched scene-level control, scene-level bootstrap comparisons, and extensive router variants help characterize the method’s benefits and limitations. The paper also explicitly acknowledges cross-domain failures and deployment overhead.
3. Informative analysis of correction and selection. The paper distinguishes transferable correction quality from routing reliability. Local action diagnostics and oracle-selected stitching show that some regional selection opportunities survive the reconstruction pipeline, although the deployed router does not consistently exploit them.
Critical weaknesses
1. Dependence on the initial global predictor remains unclear. All experiments use FastVGGT as the global predictor, leaving open whether the residual corrections primarily compensate for FastVGGT-specific limitations or also benefit stronger initial reconstructions. Evaluating the teacher models independently does not establish applicability across backbones. Please evaluate VGGT and stronger models as initial predictors under matched training and evaluation protocols, reporting both reconstruction gains and computational costs. This would clarify how the method’s effectiveness changes as initialization quality improves.
2. Robustness of co-visible grouping to initial geometry errors is insufficiently evaluated. Group construction depends on predicted depth and camera parameters. Errors in these estimates can propagate through 3D clustering, cross-view associations, window projection, routing features, and residual fusion. Since camera parameters remain fixed, depth-only refinement may not adequately compensate for such errors. Please investigate this sensitivity through controlled depth and pose perturbations, varying initialization quality, and comparisons using alternative geometry for grouping. Reporting grouping stability, action-selection changes, and reconstruction accuracy would help establish robustness.
3. Scale handling in residual transfer requires clarification. The proxies predict additive depth residuals capped at 1.5, but a relative-error loss alone does not make this parameterization scale-equivariant. If teacher and baseline depths have different scales, the proxies may conflate scale compensation with local geometric correction; the fixed residual bound may further introduce scale dependence. The median-depth and depth-variation routing features are also scale-sensitive. Please specify how teacher and baseline scales are reconciled, the scale in which the residual bound is defined, and whether normalization is consistent between training and inference. A geometrically equivalent global-rescaling test should examine whether residuals scale accordingly, routing decisions remain stable, and final scale-aligned accuracy is preserved. Per-window evaluation alignment does not establish scale equivariance of the model itself.
4. The advantage of regional routing over simpler strategies remains unestablished, and overall gains are limited. On ETH3D, RAGR improves over Raw but not significantly over the matched scene-level control; on TNT, its AbsRel is worse than both. Fixed Regime- and VGGT-derived corrections also achieve lower mean AbsRel than RAGR on both benchmarks. These results support the correction modules more clearly than adaptive regional selection. Although target-domain action rankings are unavailable at deployment and the source-selected fixed action is Raw, stable cross-domain benefits from regional routing remain unproven. Please compare against additional simple strategies selected exclusively using source data, across more target domains and random seeds, with paired confidence intervals and accuracy–cost comparisons. Given the mismatch between local supervision and scene-level evaluation, it would also be useful to test whether aligning the routing objective with the final evaluation improves its advantage over these controls.
5. Qualitative evidence is insufficient to explain the benefits and failure modes of local refinement. The current visualization covers only two ETH3D scenes, providing limited evidence across geometric structures, texture conditions, and visibility patterns, with no comparable analysis of TNT failures. Please include representative successes and failures from both benchmarks, showing RGB, ground-truth depth, Raw, fixed corrections, RAGR, error maps, and routing decisions under consistent visualization settings. Multi-view regional comparisons and detailed point-cloud views would further reveal whether corrections improve geometry, introduce boundary artifacts, or fail because of grouping or routing errors. Examples should follow a predefined selection protocol to limit cherry-picking.
Questions for authors
All questions are detailed in the weaknesses above.