- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Arbi3R, a feed-forward framework for arbitrary-scale novel view synthesis from sparse low-resolution images. A VGGT-based encoder extracts multi-view features, a coarse renderer generates target-view features, and EDDA retrieves additional source-view information through epipolar-guided sampling. A coordinate-conditioned decoder then produces images at different resolutions. The model is trained across continuous scales and evaluated on reconstruction quality, cross-dataset generalization, and multi-view consistency.
Critical strengths
-
The system achieves consistently strong reported reconstruction results. Improvements across several datasets and zero-shot evaluations make the method practically interesting. Supporting multiple output resolutions with one model also provides useful flexibility.
-
Direct access to source-view information is effective. EDDA improves PSNR by approximately 1 dB in Table 6 and improves the reported consistency metrics. These results support the usefulness of supplementing coarse target-view features with source-view evidence.
Critical weaknesses
- The paper overstates its contribution to arbitrary-scale 3D reconstruction, and experimental comparisons do not adequately test the claimed advance.
In Eqs. (2)-(4), CVR and EDDA operate on a fixed low-resolution target grid. Higher-resolution outputs are produced by coordinate-based decoding of these target-view features, without refining the geometry-guided correspondence sampling for the additional output pixels. The features are multi-view conditioned, so this is more than ordinary single-image SR. Nevertheless, I view the main contribution as the addition of continuous-resolution decoding to a geometry-conditioned NVS pipeline, with limited innovation in the underlying 3D modeling.
The motivation further exaggerates the limitations of explicit representations. A fixed Gaussian representation can be rasterized at different resolutions. Changing the output grid does not inherently require changing the primitive count. Whether it produces good detail at those resolutions is an empirical question. SRSplat also reports cross-resolution generalization, including training at 2x and testing at 4x, contradicting the categorical "one trained model, only one scale" characterization.
The most relevant controls are missing. Table 3 enlarges fixed-scale baseline images using SRNO rather than directly rasterizing their Gaussian representations at the requested resolutions. It also omits comparison against Arbi3R's own x4 prediction resized to larger scales. These controls would directly test the value of continuous-scale decoding.
Other comparisons are less convincing for assessing the new architecture. Arbi3R has approximately four times as many parameters as SR3R, while the LargerNVS+SRNO baseline passes only rendered RGB to the SR model, unlike Arbi3R's richer feature and source-image connections. EDDA's overall gain is meaningful, but its dual streams, deformable offsets, top-m selection, and sparse gating receive little individual examination. Finally, all inputs are 64x64 under a single synthetic bilinear-resizing protocol, which substantially limits the practical scope of the evaluation.
- The scale encoding and sparse detail fusion have concrete technical problems that conflict with the paper's anti-aliasing and continuity explanations.
Appendix A derives a scalar variance from a pixel cell in normalized 2D image coordinates, but Eq. (5) applies it to six-dimensional Plucker-ray features. The corresponding footprint in ray coordinates depends on the camera projection and the transformation into ray directions and moments. Image-cell area alone does not describe that footprint. Moreover, the attenuation weakens as the requested output resolution increases, although CVR’s sampling grid remains fixed. I consider this heuristic scale conditioning. The claimed footprint integration and alias-free rendering do not follow from the derivation.
Eq. (10), as written, also introduces an avoidable discontinuity into the detail features. With a single active neighbor having feature () and weight (), the normalized feature is () for any (), but becomes zero when the valid weight reaches zero. Thus, an arbitrarily small contribution retains its full amplitude until its support disappears. View-dependent hard top-percentage selection introduces further discrete changes in the available features. The downstream decoder receives the valid weight and may compensate, so this does not prove visible flicker. However, the formulation introduces artificial feature jumps and relies on the decoder to suppress them, an awkward design for continuous-coordinate reconstruction.
Questions for authors
-
Using existing checkpoints on a small DL3DV subset, please compare direct rasterization of the x4-trained Gaussian baselines at x3, x5.6, and x8 against the reported cascades. Please also compare Arbi3R's direct x5.6/x8 predictions with its own x4 output resized to those resolutions.
-
How does the image-space variance in Eq. (16) map to a footprint in Plucker-ray coordinates, and why is the final output footprint appropriate for the fixed-resolution CVR? If this is heuristic scale conditioning, please revise the derivation and alias-free interpretation accordingly.
-
Does the implementation of Eq. (10) use denominator stabilization or additional weighting not shown in the equation? Please clarify its behavior as the valid weight approaches zero, and provide a small existing-checkpoint test around mask-support boundaries to assess whether the feature discontinuity produces abrupt RGB changes.