- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
RaViS proposes a transformer for novel-view synthesis that uses features and geometry from a frozen VGGT-Ω model. Its main contribution is Point-Anchored Geometric Embedding (PAGE), which extends camera-relative attention by anchoring each patch at an estimated 3D point. Target anchors are obtained by projecting context geometry into the target view. The method achieves strong reported results on RealEstate10K, DL3DV, and zero-shot transfer datasets.
Critical strengths
- PAGE is a clear and technically motivated extension of existing geometric attention. Table 4 provides direct evidence for point anchoring: replacing camera-centered anchors with 3D-point anchors improves PSNR from 23.80 to 24.44 dB with the other inputs and training settings fixed.
- The evaluation spans different overlap regimes, context-view counts, and unseen datasets. Retraining the DL3DV baselines under a shared data and training setup is a useful effort toward controlled comparison.
- Reusing appearance and geometry features from a frozen GFM is an effective design, and Table 5 separately examines their contribution. The manuscript also acknowledges approximate target anchors and the fallback used in uncovered regions.
Critical weaknesses
The proposed mechanism does not establish the claimed separation between geometry errors and image artifacts. The motivation argues that geometry errors merely change where the model attends, instead of appearing as artifacts, because the geometry is not rasterized into RGB content. However, PAGE still directly couples estimated point-cloud geometry to the synthesis transformer. In Eq. 5, the relative geometric transformation affects both the attention logits and the transformed values, and this operation is repeated at every layer. Target anchors also depend on projected context geometry. There therefore remains a direct pathway by which depth, pose, or anchor errors can affect the synthesized image.
Using geometry to guide attention is a reasonable design. My concern is the unsupported inference that this interface prevents geometric errors from becoming image artifacts. This distinction is particularly relevant to PVSM, whose projected image conditions a learned synthesizer rather than forcing the final output to reproduce the projection. The PAGE ablation supports its effectiveness, but does not isolate robustness to geometry errors. Controlled perturbations with latent features held fixed, or a narrower explanation of the empirical results, would strengthen the paper.
The behavior under incomplete target geometry remains insufficiently characterized. Empty target patches fall back to camera-centered anchors, but the supplied results do not identify these regions or quantify their prevalence and reconstruction quality. Results with fallback masks, coverage statistics, and smooth camera trajectories would clarify whether synthesis remains reliable when anchors are missing or switch between valid geometry and fallback.
Questions for authors
- Could you explain the differences between the GT-camera baseline results in Table 1 and the overlap results reported in PVSM’s Table 2 as well as Less3D [1] Table 3?
- If possible, please provide video results rather than still images. My experiences on view synthesis models, especially when conditioned or based on geometry inputs, contain cross-frame inconsistencies. RaViS avoids rasterizing geometry into RGB content, but still projects context points to construct target anchors. Changes in visibility, patch membership, or the transition between a valid anchor and the camera-center fallback could introduce abrupt changes in the conditioning. Sparse projection alone does not prove flickering, and the static image results do not resolve this question.
Please provide smooth camera-path renderings with a fixed context set and fixed GFM predictions, ideally alongside projected depth and an anchor-validity mask. This would help assess behavior around thin structures, occlusion boundaries, and uncovered regions. The nearest-context selection used in zero-shot evaluation can be tested separately, since switching context views introduces another possible source of discontinuity. I regard this as an open robustness question rather than an observed failure.
Thanks for the additional experiments and clarifications. I find the additional analysis on PAGE to be compelling. Given that and the overall quality of the results/paper, I will be raising my score.