- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
-
Well-motivated dual-grouping design for fine-grained reconstruction: Combining view-wise grouping with 3D spatial grouping addresses a clear limitation of local multi-view attention: geometrically related tokens may be separated by view-group boundaries. FineSplat reconnects these tokens using their predicted 3D positions and incorporates rendering-error feedback to guide iterative correction. This provides a coherent mechanism for integrating fine-grained cross-view information.
-
Strong rendering quality with a compact Gaussian representation: FineSplat demonstrates a compelling balance between reconstruction quality and primitive count compared with pixel-aligned baselines. On DL3DV with 24 posed input views, it improves PSNR by 2.88 dB over 2Xplat while using approximately one-quarter as many Gaussians (Table 1). The same DL3DV-trained checkpoint also achieves strong results on RE10K and ScanNet++, providing useful evidence of cross-dataset generalization.
Critical strengths
-
Well-motivated dual-grouping design for fine-grained reconstruction: Combining view-wise grouping with 3D spatial grouping addresses a clear limitation of local multi-view attention: geometrically related tokens may be separated by view-group boundaries. FineSplat reconnects these tokens using their predicted 3D positions and incorporates rendering-error feedback to guide iterative correction. This provides a coherent mechanism for integrating fine-grained cross-view information.
-
Strong rendering quality with a compact Gaussian representation: FineSplat demonstrates a compelling balance between reconstruction quality and primitive count compared with pixel-aligned baselines. On DL3DV with 24 posed input views, it improves PSNR by 2.88 dB over 2Xplat while using approximately one-quarter as many Gaussians (Table 1). The same DL3DV-trained checkpoint also achieves strong results on RE10K and ScanNet++, providing useful evidence of cross-dataset generalization.
Critical weaknesses
-
Limited differentiation from prior work and insufficient isolation of the contributions: FineSplat builds on the MVP architecture and the two-expert formulation of 2Xplat, while its rendering-error-driven recurrent refinement is closely related to ReSplat. Although the proposed visibility-aware error aggregation and serialized refinement of fine-grained tokens introduce specific differences, their advantages are not sufficiently established through direct comparisons and controlled ablations. ReSplat is cited but not directly compared, and the existing ablations do not independently isolate the contribution of 3D spatial grouping from rendering-error feedback or additional refinement computation. In particular, Table 5 modifies the observations used for error aggregation rather than the spatial attention mechanism, while Table 8 lacks a variant without rendering-error inputs. Comparisons under matched initialization, Gaussian budget, and training conditions would clarify the contribution beyond the established components.
-
Incomplete scalability evaluation on the main benchmark and insufficient computational validation: Although DL3DV serves as the primary in-domain benchmark, its evaluation is restricted to 6, 12, and 24 input views. Many-view experiments with 32, 64, and 128 views are provided only on ScanNet++. While these results offer useful evidence of cross-dataset generalization, they leave unanswered whether the reported advantages persist beyond 24 input views on DL3DV itself. Evaluating larger input sets on the main benchmark would therefore provide more direct support for the claimed scalability. Furthermore, despite motivating the architecture through computational efficiency, the paper does not report reconstruction latency, rendering FPS, peak GPU memory, or FLOPs relative to baselines. This omission is particularly relevant given the overhead of repeated context rendering, error-feature extraction, and cross-view aggregation. Resolution scaling is also insufficiently explored: the main evaluation uses 224 × 224 images, with an additional 252 × 252 evaluation in Appendix C.4, but no quantitative evaluation at substantially higher resolutions such as 540 × 960.
Questions for authors
-
Many-view scalability on the main DL3DV benchmark: The evaluation on DL3DV is limited to 6, 12, and 24 input views, whereas experiments with 32, 64, and 128 views are provided only on ScanNet++. Could the authors extend the evaluation on DL3DV to larger input sets, such as 64 and 128 views, to establish whether the reported advantages persist on the primary in-domain benchmark?
-
Computational efficiency and high-resolution performance: Could the authors report end-to-end reconstruction latency, peak GPU memory, and FLOPs across input resolutions and view counts, with novel-view rendering FPS reported separately? A breakdown covering the DA3 geometry expert, Stage 1, and Stage 2—including repeated rendering, error-feature extraction, and cross-view aggregation—would clarify the practical computational benefits. Beyond the current 224 × 224 and 252 × 252 evaluations, could the authors also provide reconstruction-quality and efficiency comparisons at substantially higher input and rendering resolutions, such as 540 × 960?
-
Isolating the contributions of 3D grouping and rendering feedback: Could the authors compare the full model with (i) the same 3D refinement module without rendering-error inputs, retaining the image-context features, and (ii) a refinement module using the same error features and number of refinement steps but image-space or non-geometric grouping? Matching the initialization, Gaussian budget, and training protocol would help establish how much of the improvement comes specifically from the proposed 3D interactions, beyond rendering feedback and additional refinement computation.
-
Direct comparison with ReSplat: ReSplat is closely related because it also combines compact Gaussian initialization, rendering-error feedback, and recurrent 3D attention. Could the authors include a direct comparison under a common posed evaluation protocol and clarify the specific advantages of FineSplat’s visibility-aware error aggregation and serialized refinement of fine-grained tokens?
-
Gaussian-budget control and quality trade-off in Figure 1: What configurations produce the FineSplat results with 301K, 251K, and 213K Gaussians in Figure 1? Do these correspond to different opacity-pruning thresholds or other changes? Beyond the unpruned and default-pruned results already reported, could the authors provide a broader quality-versus-Gaussian-count curve, identify the settings used in the figure, and show where further compression begins to substantially degrade reconstruction quality?
-
Comprehensive Comparisons and Baseline Exclusions on RE10K: Could the authors provide a more thorough comparison on the RE10K dataset across a broader range of input view numbers to better demonstrate the framework's robustness and scalability under varying data sparseness? In the main comparison tables, a significant number of baseline methods are greyed out or omitted. Could the authors clarify the criteria for excluding these methods, and include comparisons against recent state-of-the-art feed-forward 3DGS methods under a unified and fair evaluation protocol?