- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
DeltaSplat iteratively refines a feedforward Gaussian distribution using rendering residuals based on Plücker rays and rendering depth. A shared refinement module is responsible for predicting updated values for position, opacity, and color. Experimental results show that the performance of novel view synthesis are improved across various camera setups, numbers of views, and datasets.
Critical strengths
-
The improvement in rendering performance is significant: on the DL3DV dataset, when using predicted poses and known intrinsic parameters, DeltaSplat outperforms YoNoSplat by 1.75 dB, and this improvement is consistently maintained across different numbers of views and on other datasets.
-
Experiments on removing geometric conditions also valuable: removing ray and depth information resulted in a 1.37 dB decrease in PSNR, indicating that these components are critical to the proposed architecture.
Critical weaknesses
-
The robustness of this method against camera uncertainties has not yet been directly verified. Whether using a simulated or a real camera, the resulting gains cannot be distinguished between error correction and a general Gaussian smoothing process.
-
Illumination and depth data are removed jointly, it is not possible to clearly identify their respective contributions or how they complement each other.
Questions for authors
-
Can controlled camera perturbations demonstrate whether geometric conditioning improves robustness to pose errors?
-
Can you provide ray-only and depth-only ablations to clarify their individual contributions and complementarity?
3 comments
Thank you for the clarifications and additional experiments. The reported ray-only and depth-only ablations address my concern about their individual contributions and support the benefit of joint conditioning.
The perturbation results provide useful evidence of improved rendering under camera errors, although they do not isolate whether geometric conditioning itself improves robustness. Please update the manuscript PDF to include the new experiments.
Overall, the response substantially addresses my concerns, and I maintain my weak accept recommendation.
Response to Reviewer xDDd
Thank you for your thoughtful feedback and for acknowledging that the additional ablations address your concerns. We will incorporate the new ablation and camera perturbation results into the revised manuscript.
Response to Reviewer xDDd
We thank the reviewer for highlighting camera uncertainty and the individual roles of the geometric inputs. We address both concerns with additional experiments.
Q1. Does camera perturbation testing show robustness beyond generic smoothing?
We added controlled camera perturbations on 140 DL3DV scenes at 224×224, using rotation/translation errors of 1°/2%, 2°/5%, and 5°/10% with 2, 4, 6, 12, and 24 input views. DeltaSplat outperforms ReSplat in all 15 settings by 0.13-1.91 dB (Table R8). Its rendering advantage therefore persists across the tested uncertainty levels, although absolute quality decreases as perturbations grow. At the strongest perturbation (5°/10%), the gains are +1.91 dB with two views and +0.13 dB with 24 views. Thus, gains remain positive but vary with the input configuration.
To examine the role of explicit geometry, we separately ablate the conditioning inputs. Removing rays and depth reduces PSNR by 1.37 dB (Table R7), while Figure 5 shows larger, more dispersed position updates. Conditioning thus affects spatial corrections as well as output image quality. Because cameras remain fixed, the perturbation study evaluates whether Gaussian updates retain a rendering advantage when camera geometry is imperfect. Together, these results support better rendering under camera errors and geometry-dependent refinement. The full-model comparison does not isolate conditioning's contribution to robustness or establish metric 3D accuracy.
Q2. What are the individual and complementary contributions of rays and depth?
We added ray-only and depth-only variants (Table R7). Without geometry, PSNR is 25.27 dB; rays alone reach 25.93 dB and depth alone reaches 26.25 dB. Each input therefore contributes, with depth providing the larger individual gain in this setting. Both single-input variants also improve SSIM and LPIPS.
The combined model achieves 26.64 dB PSNR, 0.862 SSIM, and 0.115 LPIPS, the best result across all three metrics. Adding rays to depth improves PSNR by a further 0.39 dB; adding depth to rays provides 0.71 dB. Joint conditioning therefore improves on either signal alone.
The signals provide distinct spatial information. Plücker rays describe viewing lines derived from fixed context cameras. Rendered depth estimates where the current reconstruction lies along those lines and changes as the Gaussians are refined. A 2D residual alone does not uniquely determine a 3D correction: an image error can be reduced through position, opacity, or color changes. The two signals provide complementary spatial context for choosing these updates without camera reoptimization. These estimated geometric inputs serve as soft conditioning: they provide context for predicting corrections, without constraining updated positions to match the current rendered depth.
Tables R1–R8 are provided in the accompanying Official Comments titled "Supporting Experiments (1/2)" and "Supporting Experiments (2/2)".