- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes ConstraintGS, a regularization method for sparse-view 3D Gaussian Splatting that attenuates the opacity of weakly constrained Gaussian primitives. The core idea is a cross-view constraint descriptor that combines two factors: the effective rendering support a primitive receives and the directional coverage of that support. The descriptor is converted into a scene-relative pressure, then into a bounded per-primitive attenuation fraction under a prescribed mean budget and per-primitive cap, applied directly to host opacities after the optimizer step without gradient tracking or additional learned parameters. The authors motivate the design with diagnostics showing that rendering support is highly uneven across primitives and that the proposed constraint score correlates with local photometric response. Experiments integrate ConstraintGS into five host methods (3DGS, FSGS, CoR-GS, DropGaussian, D²GS) across LLFF, Mip-NeRF 360, and Blender, reporting consistent PSNR improvements, with ablations isolating the contributions of self-opacity normalization, support magnitude, directional coverage, and descriptor-guided versus uniform/shuffled allocation.
Critical strengths
The design is principled and well-motivated by analysis: the self-opacity normalization is justified analytically, the log-determinant score is shown to jointly encode support magnitude and directional balance with a clean spectral interpretation, and the bounded allocation is derived as a Euclidean projection onto a budget-constrained set. The ablation study directly tests each design choice, making the empirical case for the descriptor's specific form rather than mere attenuation.
Critical weaknesses
The empirical gains are inconsistent across metrics and datasets, and the evidence for the method's central mechanism is weaker than the framing suggests. On LLFF, PSNR improves substantially, but SSIM and LPIPS degrade for several host pairs (e.g., FSGS on LLFF 3-view 1/8: PSNR up but LPIPS worse; CoR-GS on Blender: SSIM and LPIPS both worse; DropGaussian on Blender: SSIM and LPIPS worse; D²GS on LLFF 1/4: PSNR and SSIM worse), and the parameter sensitivity table shows LPIPS degrading sharply (0.1910 → 0.2087) with only a small budget increase. Since the method's stated purpose is to improve reconstruction under sparse views, and perceptual metrics are the ones most directly tied to visual quality in novel-view synthesis, this mixed picture is consequential: it suggests the PSNR gains may partly reflect a bias of opacity attenuation toward smoother, background-dominated renderings rather than uniformly better geometry. The paper does not analyze why some hosts regress, nor does it characterize the conditions under which the method should be expected to help.
Questions for authors
Please resolve the aforementioned issues.
2 comments
I have carefully reviewed the authors' response as well as the comments from the other reviewers. All my concerns have been appropriately resolved, I have no further questions and will raise my score, thanks for the efforts.
Response to Reviewer gy3K
Thank you for recognizing the motivation behind the constraint descriptor and for asking whether the PSNR gains could come from smoother, background-dominated renderings. We agree that PSNR alone cannot distinguish artifact removal from a loss of detail. We examine these possibilities in Appendix D.3 of the revised manuscript.
1. Which metrics regress? The table below summarizes the settings raised in the review and the two additional settings where LPIPS worsens. Each entry shows baseline → baseline with ConstraintGS; bold marks a regression (Tables 1–2).
We would like to clarify three of the examples cited in the review. The values for these host–setting pairs are unchanged from the original submission. On LLFF, FSGS at 1/8 resolution improves in LPIPS, and D²GS at 1/4 resolution improves in both PSNR and SSIM. On Blender, DropGaussian improves in SSIM, although its LPIPS does worsen. We agree with the reviewer that the perceptual regressions deserve analysis: both SSIM and LPIPS worsen for CoR-GS on Blender, and LPIPS also worsens in the two Mip-NeRF 360 settings shown above. We analyze selected cases below.
2. Are the gains mainly due to smoother backgrounds? On Blender, PSNR and LPIPS both increase in 81 of 200 paired test views for CoR-GS and 87 of 200 for DropGaussian. Using ground-truth masks across all test views, we find that the background accounts for 69.9% of the mean MSE reduction for DropGaussian. Figure 12 shows one source of that gain: a dark artifact below the ship’s base is reduced where the reference is white. For CoR-GS, however, 59.1% of the reduction comes from the foreground (Table 7); Figure 12 shows lower error on the base of a sphere in materials. The background thus accounts for most of the MSE reduction for DropGaussian, but not for CoR-GS. Across the four views in Figure 11 where LPIPS worsens, we do not observe a consistent visible loss of sharpness. The supplementary videos provide additional viewpoints for comparison.
3. Why can perceptual quality worsen, and when should attenuation help? For FSGS on Mip-NeRF 360, PSNR and LPIPS both increase in 85 of 206 paired test views. Figure 13 shows how a visible improvement and a local regression can coexist. In room, a reddish foreground artifact is reduced, but texture seen through the window becomes less distinct. Replacing only the blue-boxed window region of the baseline with the corresponding pixels from our rendering raises full-image LPIPS from 0.3048 to 0.3066. The window change alone thus worsens LPIPS, although the increase is smaller than for the complete rendering, where LPIPS reaches 0.3249 while PSNR improves from 16.66 to 18.19 dB. In kitchen, the local regression takes a different form: the artifact behind the tabletop is reduced, but the toy’s yellow panel becomes more mottled, not smoother.
A plausible limitation follows from what the score measures. A weakly supported Gaussian may spuriously occlude a surface, in which case attenuating it can reveal that surface. But a Gaussian contributing to a real detail in a novel view may also score low if it receives support from only a narrow range of training directions. Attenuating it can then alter the color or texture of that detail.
Despite this local ambiguity, the six hosts support a common empirical principle for sparse-view 3DGS: the amount and directional coverage of a Gaussian’s training-view support are useful guides for deciding how strongly to attenuate its opacity. With the same regularization settings across hosts and datasets, ConstraintGS improves PSNR in all 23 comparisons, SSIM in 21, and LPIPS in 19. Its benefits thus extend across hosts and, in most settings, to perceptual similarity.
4. Does the allocation matter, and how sensitive is it to the budget? With 3DGS on three-view LLFF at 1/8 resolution, uniform and shuffled allocation reach 20.40 and 20.42 dB, with LPIPS of 0.203 and 0.200, respectively. Under the same mean budget, cap, and schedule, descriptor-guided allocation reaches 21.05 dB and 0.191 LPIPS (Tables 3 and 5). Thus, even at fixed mean strength, which Gaussians receive stronger attenuation matters. We also agree that perceptual quality is sensitive to the budget: increasing it from 1.5% to 2.25% at a fixed cap-to-budget ratio changes PSNR only from 21.05 to 20.99 dB, but worsens LPIPS from 0.1910 to 0.2087 (Table 4). Section 5 discusses this trade-off (lines 487–489).