- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper tackles sparse-view indoor reconstruction with 3D Gaussian Splatting by explicitly guiding both densification decisions and split directions using persistent structural roles assigned at initialization. The method initializes ordinary, line, and planar Gaussians, ranks densification candidates via a type-calibrated score that balances absolute positional gradients with within-type normalized rendering contribution, and constrains split displacements to structure-aligned subspaces. Combined with depth/normal/planarity regularization from a joint multi-view depth prior, the approach yields improved perceptual quality and better structural preservation on ScanNet, Replica, and NRGBD, with favorable training time and model size.
Critical strengths
-
Introduces persistent structural roles that are inherited across densification, decoupling split subspaces from evolving covariance orientations.
-
Proposes type-calibrated candidate selection: absolute screen-space gradient for demand, modulated by within-type percentile-normalized rendering contribution under a shared Top-K budget.
Critical weaknesses
-
The hard inheritance of structural roles risks locking in early misclassifications with no mechanism to retype or relax constraints; this could hinder recovery from initialization errors.
-
Excluding low-texture planar Gaussians from densification may under-represent legitimate small-scale structure on homogeneous planes, depending on the plane-level texture aggregation.
Questions for authors
How robust is the framework to misclassifications of plane-high vs plane-low texture? Do you support retyping or adaptive promotion of plane-low Gaussians when residuals persist on these planes?
3 comments
Thank you for the careful rebuttal for structural roles, excluding low-texture plane, and its robustness. My concerns have been resolved. I maintain my score.
Thank you for your careful review and for confirming that your concerns have been resolved. We sincerely appreciate the time and attention you devoted to reviewing our work and the additional evidence.
Best regards,
The Authors
Q1: Can hard inheritance of structural roles lock in initialization errors?
Thank you for your thoughtful comments. We agree that incorrect structural attributes at initialization could propagate to subsequent generations through attribute inheritance. We clarify that our current framework does not support online structural reclassification or explicit relaxation of inherited constraints. Continuous optimization updates Gaussian centers, covariance parameters, and appearance attributes, while structural types and their stored geometric references remain fixed. For planar Gaussians, the actual split direction can adapt within the inherited tangent plane (Sec. 3.3, Child Construction and Attribute Inheritance). Therefore, continuous optimization alone cannot fully correct an initially misclassified structural role.
To mitigate this risk, we adopt conservative filtering and geometric consistency checks before assigning structural attributes. Specifically, unreliable line segments are filtered based on detection confidence and length (Sec. 3.1.1, Eq. (3); Appendix A.5). For planar priors, we first obtain per-view planar masks and semantic labels using LP3, and then perform cross-view plane association using PCA-based plane fitting and geometric consistency checks. These checks consider plane-normal differences, plane offsets, and spatial overlap or centroid proximity (Appendix A.4). Furthermore, the high-/low-texture classification employs robust per-view statistics, including percentile clipping and minimum valid-pixel requirements, followed by pixel-count-weighted multi-view voting to reduce sensitivity to individual-view errors (Appendix A.4, Eqs. (15)–(16)).
More importantly, we conduct additional perturbation experiments to evaluate the sensitivity of subsequent structural growth to imperfect initialization. Please refer to Rebuttal Table R3 in our response to Reviewer eyrC, Q4, which reports sensitivity to 20% high-/low-texture label flipping and 10° line-direction perturbations on Replica.
Q2: Can excluding low-texture planes from densification miss legitimate fine-scale structure?
We thank the reviewer for raising this important concern. We agree that low texture does not necessarily imply the absence of fine-scale geometric structures. The policy is a capacity-allocation choice under sparse supervision: unrestricted growth on homogeneous surfaces may fit ambiguous photometric evidence without reliably recovering additional structure.
Plane-low regions receive an initial Gaussian representation whose parameters remain trainable. Excluding these Gaussians from cloning and splitting restricts additional capacity, while their existing geometry and appearance can still adjust. This flexibility cannot replace additional primitives when the initial support is insufficient.
Texture classification combines robust per-view gradient statistics, percentile clipping, valid-pixel requirements, and pixel-count-weighted multi-view voting (Appendix A.4). In addition, detected lines take precedence over planar sampling (Sec. 3.1.1), so recognized narrow structures can receive line Gaussians independently of the surrounding plane's texture role.
These measures do not guarantee preservation of every local feature. Plane-level voting may overlook small same-color details, and line initialization cannot protect undetected structures. We therefore acknowledge possible under-representation of local geometry on low-texture planes. The perturbation test measures aggregate sensitivity, rather than directly validating preservation of those fine structures.
Q3: How robust are texture roles, and is residual-triggered promotion supported?
We thank the reviewer for raising this important concern. We agree that low texture does not necessarily imply the absence of fine-scale geometric structures, and incorrectly classifying a high-texture plane as Plane-low could restrict its capacity to represent local details. Residual-triggered retyping or promotion is not supported in the current method. A Plane-low Gaussian remains outside the densification candidate pool even when residuals persist. Its continuous parameters can change, but its structural role and growth eligibility do not. Under the tested 20% texture-label flipping, PSNR decreases from 33.50 to 33.41 dB, while SSIM remains 0.958 (Rebuttal Table R3 in our response to Reviewer eyrC, Q4). This indicates limited aggregate sensitivity in the tested setting, rather than correction of misclassified roles or guaranteed preservation of local details.