- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper targets sparse-view 3D Gaussian Splatting, where pixel fitting and densification can reinforce ambiguous scene explanations. EviSR-GS computes an input inconsistency map from local depth residuals and RGB-depth gradient mismatch, then uses it to balance pixel reconstruction and patch-level perceptual losses. A second branch proposes candidate Gaussians at low-coverage or depth-inconsistent locations, ranks them using cross-view depth statistics and rendered coverage, and inserts a limited number per event. New Gaussian lineages are protected from ordinary pruning during a maturation period. After maturation, additions with both low opacity and low accumulated visibility are softly attenuated. The method is evaluated on LLFF, DTU, and Mip-NeRF 360, with comparisons to sparse-view NeRF and Gaussian methods and additional input-view settings on LLFF.
Critical strengths
- The method treats local appearance supervision and Gaussian capacity allocation as related but distinct decisions, avoiding the assumption that every large image residual should receive stronger pixel fitting.
- The maturation period preserves newly inserted lineages while they adapt jointly with the existing scene representation. This is a clear response to the instability that can arise when new primitives are immediately judged by opacity or visibility.
- The refinement branch operates within the existing 3DGS pipeline and carries insertion, lineage, and activity state through ordinary densification and pruning events.
Critical weaknesses
- The supervision weight is a fixed combination of local depth variation and RGB-depth gradient mismatch, rather than a calibrated measure of depth correctness. Valid depth discontinuities, texture edges, or errors in the fixed prior can therefore reduce pixelwise constraints even when the measurements are reliable.
- Candidate construction requires finite positive rendered depth before applying the low-coverage trigger, and the paper explicitly says this excludes completely uncovered pixels. This leaves zero-coverage locations outside refinement even though low coverage motivates the trigger.
- Cross-view candidate statistics use nearest-neighbor depth comparisons without an additional occlusion mask. A candidate behind an occluder can appear unsupported, while a cross-view-consistent error in the fixed depth prior can appear well-supported even though agreement alone does not establish correctness.
- Post-maturation attenuation uses only current opacity and accumulated rendering visibility. These quantities describe contribution and exposure during training, but do not establish whether an addition represents a valid surface. Repeated attenuation can consequently reduce a useful but rarely visible structure.
Questions for authors
- How do the authors distinguish unreliable depth from valid depth discontinuities or texture edges that can produce similar signals in the supervision weight?
- If the fixed depth prior contains a systematic error that is consistent across views, can the cross-view support score distinguish it from a valid surface?
5 comments
further questions
Thanks for the response. I still have two questions about the refinement part:
-
In Table 15(a), the version without refinement actually looks better on SSIM/LPIPS. So what is refinement really adding?
-
Most inserted points have no cross-view support, and attenuation rarely fires. So if a new Gaussian is placed at the wrong depth, what removes it?
Response to Reviewer HvAp: refinement contributions and handling of misplaced Gaussians
Thank you for the follow-up questions.
- Contribution of refinement. Refinement adds trainable capacity in regions with low coverage or depth disagreement. With the main spatial supervision retained, enabling refinement improves mean PSNR by 0.1780 dB, SSIM by 0.0019, and LPIPS by 0.0060 (Table 9(b)). This directly demonstrates its contribution alongside the supervision branch. Table 15(a) examines a separate configuration using full-image perceptual supervision without maturation protection. There, refinement improves PSNR by 0.0794 dB, with a small SSIM/LPIPS trade-off. The two comparisons establish an improvement across all three metrics under the main configuration and a more limited benefit under the supplemental configuration.
- Handling misplaced Gaussians. Newly inserted Gaussians undergo joint optimization of position and appearance. After maturation protection expires, ordinary pruning can remove eligible low-opacity additions, subject to the protection rules. Ordinary pruning remains active regardless of whether activity attenuation fires. Attenuation provides an additional reduction in the influence of mature additions with both low opacity and low visibility. An incorrectly placed Gaussian that remains active can survive, because the activity criterion measures rendering activity rather than depth accuracy. Our refinement mechanism therefore provides an optimization opportunity followed by activity-based management; its demonstrated benefit is improved held-out reconstruction in the complete method.
Response to Reviewer HvAp: supervision, prior errors, and refinement
Thank you for distinguishing appearance supervision, capacity allocation, and the initial optimization period. The revision makes the role of each cue explicit and adds direct controls. All references below use the revised numbering.
W1/Q1 — Valid edges versus depth errors. U does not fully distinguish these causes; it measures inconsistency in the fixed RGB/depth inputs. We use it to balance exact pixel matching and local patch appearance, both against the same observed RGB. This preserves appearance supervision when pixel weights are reduced. Appendix A.1 bounds texture-induced downweighting: with zero local depth-residual energy, at least 74.7% of pixel weight remains even under maximal gradient mismatch. Valid depth discontinuities can still yield high U. The justification is the measured supervision benefit: spatial weighting improves PSNR/LPIPS by +0.14 dB/-0.005 with both losses retained (Table 2), and complete U removal increases three-seed mean LPIPS from 0.1622 to 0.1757 and reduces SSIM from 0.7602 to 0.7544 (Table 3(a)).
W3/Q2 — Systematic prior errors and occlusion. A wrong surface consistently represented in the fixed priors can receive high support. Agreement alone cannot distinguish that error from a correct surface. Our comparison uses nearest-neighbor sampling without an additional occlusion mask, so occlusion and boundary sampling can also increase discrepancy and demand. Table 12 quantifies selection sensitivity to source- and comparison-prior perturbations. Demand therefore specifies insertion priority, and the selected Gaussians remain subject to joint RGB optimization; support is not a geometric correctness test. Table 3(b) establishes the rendering benefit of the tested ranking and gate under the original priors.
W2 — Zero rendered depth. Both proposal triggers share the requirement for finite positive rendered depth. Consequently, zero-rendered-depth pixels are excluded even when the prior is valid and opacity is low. Section 3.3 states this immediately after Eq. (7). The implemented refinement addresses eligible low-coverage regions; it does not fill every completely uncovered location.
W4 — Rarely observed structures. Visibility counts rendering events, not distinct cameras. Ten visible renders from even one training view exclude an instance from attenuation. Low visibility alone is insufficient: the lineage must be mature and opacity below 0.03, subject to the active protection gates. This avoids penalizing a structure simply because few cameras observe it. A useful instance with both low opacity and fewer than ten visible renders can nevertheless be attenuated repeatedly, while a high-activity geometric error can escape attenuation. Appendix A.2 specifies these rules, including inherited lineage age and reset child visibility counts. Table 3(a) separately confirms the benefit of protecting immature lineages, improving the three-seed mean PSNR by 0.1411 dB with the assessment schedule fixed.