- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper argues that the contribution of a Gaussian to the current scene's state is different from the recoverability if removing this Gaussian, and proposes Recoverability-Aware Gaussian Pruning (RAGP), which designed a workflow to perform counterfactual probes during training, which can get Gaussians' response score. Together with a selected existing importance score, this responese score help merge into a final score that can be used to select Gaussian under a given budget.
Experiments show the effectiveness of this proposed score computing workflow by improving PSNR under the budget, while introducing approximately 36% training overhead.
Critical strengths
-
the motivation is reasonable and clear, and the paper proposes to probe the scene by masking Gaussians to test their recoverability, and utilized it to compute a score that can effectively prune Gaussians while improving rendering quality.
-
this method is universal and can be applied on top of various existing pruning methods.
Critical weaknesses
-
The readability is poor, the symbol R^{geo}_i appears in Section 3 without being defined, causing great confusion when reading this article. And the "Counterfactual Evidence" in Section 3 seems like a lot experiments with some findings, further confusing me, as the main method is only introduced later in Section 4; In Section 4, the F_mid function is not defined,
-
How do you select which part of Gaussians to be masked? This is one of the most important question but seems not be mentioned or explained. Without knowing this, I really could not fully understand the working mechanism.
-
There are enumerous formulas to derive the final score, and one has to sort them out with the help of AI, as many of them are in the Appendix and so complex designed. This makes it difficult to figure out the validity of each component, even though some designs are ablated.
Questions for authors
- Could you provide a clearer, self-contained explanation of the full mapping from gradient contrasts to the final response score?
- Could you elaborate how to select the cells/ Gaussians to be masked?
4 comments
Response part 2
[W3] Component effectiveness and design complexity
Response. The score construction is a sequence of transformations applied to one counterfactual response, rather than a collection of independent scoring modules. Each stage has a specific role: paired gradient contrasts capture intervention-induced changes; covariance-tangent mapping represents geometric variation; whitening and reliability-aware aggregation normalize and stabilize the response; and midpoint-CDF normalization produces scene-relative compensation evidence.
Core component ablation (Appendix G.1, Table 19). We evaluate the principal components and design choices at budget X. All configurations share the same 20K source state, native host prior, exact-K budget, recovery schedule, and evaluation protocol. The table reports 13-scene mean changes relative to the paired Official OMG branch.
| Configuration | ΔPSNR ↑ | ΔSSIM ↑ | ΔLPIPS ↓ |
|---|---|---|---|
| A2: Whitened Fine only | +0.10592 | +0.000656 | -0.000444 |
| A4: HRNB only (w/o Fine) | +0.01233 | +0.000499 | -0.000802 |
| Gradient norm + Host-rank | +0.09530 | +0.000133 | +0.000313 |
| Covariance tangent + Host-rank | +0.10748 | +0.000564 | -0.000249 |
| A1: Whitened + Uniform | +0.09715 | -0.000931 | +0.002017 |
| Whitened Fine w/o reliability | +0.09223 | +0.000495 | -0.000316 |
| A3: Whitened Fine + Odds-5/View | +0.10478 | +0.001226 | -0.001612 |
| Full RAGP | +0.12083 | +0.001289 | -0.001609 |
Whitened Fine provides the primary improvement (+0.10592 dB), while HRNB alone contributes +0.01233 dB. Combining them increases the gain to +0.12083 dB, an additional +0.01491 dB over Fine alone. Full RAGP achieves the highest PSNR and SSIM in this comparison, with LPIPS comparable to the best alternative.
Geometric response representation (Appendix G.4, Table 22). This independent matched diagnostic compares alternative response representations.
| Response construction | ΔPSNR ↑ | ΔSSIM ↑ | ΔLPIPS ↓ |
|---|---|---|---|
| Gradient-norm response | +0.2153 | +0.00113 | -0.00147 |
| Covariance tangent, no whitening | +0.2140 | +0.00148 | -0.00197 |
| Covariance tangent + whitening | +0.2200 | +0.00154 | -0.00207 |
Covariance-tangent whitening achieves the best results across all three metrics in this study, supporting the selected geometry-aware, optimization-normalized response.
Aggregation strategy (Appendix G.6, Table 25). This separate matched diagnostic compares Fine-only with multi-scale aggregation alternatives under the same Fine/Medium/Coarse hierarchy.
| Aggregation strategy | ΔPSNR ↑ | ΔSSIM ↑ | ΔLPIPS ↓ |
|---|---|---|---|
| Fine only | +0.2421 | +0.00164 | -0.00212 |
| Arithmetic mean | +0.2193 | +0.00144 | -0.00198 |
| Reliability-weighted mean | +0.2249 | +0.00151 | -0.00209 |
| Weighted median | +0.2238 | +0.00140 | -0.00189 |
Fine-only outperforms all evaluated multi-scale alternatives across PSNR, SSIM, and LPIPS, supporting the simpler single-scale design. The results in Tables 22 and 25 are interpreted within their respective matched diagnostic studies and are not compared numerically with Table 19.
Revision. Section 4.2 organizes the construction into four sequential stages. Component and design-choice evidence is reported in Appendix G.1 (Table 19), G.4 (Table 22), and G.6 (Table 25).
Thank you for the clarifications and additional ablations. The revised explanations of masking and response-score construction have largely addressed my concerns, and I will raise my rating to Weak Accept. I encourage the authors to add concise end-to-end pseudocode to the main text, making the computation easier to follow without repeatedly consulting the appendix.
Thank you for your positive feedback and for reconsidering our work. We appreciate your helpful suggestion. We will add concise end-to-end pseudocode to the main text in a subsequent revision to improve clarity and make the computation easier to follow. Thank you again for your constructive comments and encouragement.
Response part 1
We thank the reviewer for the constructive feedback. We have revised the manuscript to make the response-score computation and masking procedure clearer and more self-contained.
[Q1] Full mapping from gradient contrasts to the final response score
Response. We have clarified the distinction between the motivation in Section 3 and the actual score construction in Section 4.2. Specifically, Rigeo is a pre-pruning geometric compensation response, rather than a direct estimate of the retrospective, multi-step recoverability measure CT.
The complete mapping consists of four steps:
Paired gradient contrasts: Normal and Masked branches start from the same Gaussian state and camera. We compute Scale and Rotation gradient differences, while only the Normal branch updates model parameters.
Covariance-tangent mapping: The contrasts are normalized using Normal-branch gradient magnitudes, with Rotation projected onto the unit-quaternion tangent space. Both are mapped into a six-dimensional covariance-tangent representation.
Response construction: The geometric response is whitened using Normal-branch statistics, normalized by removed contribution mass, and aggregated across valid interventions using variance- and observation-count-aware reliability penalties to obtain Li.
Final score construction: We apply a tie-aware empirical midpoint CDF over Gaussians with at least four valid observations. Each score is assigned the fraction of eligible scores below it plus half the fraction tied with it. The resulting response is Rigeo=2Fmid(Li)−1. Gaussians with fewer than four valid observations receive zero response.
Revision. We explicitly define Rigeo at its first occurrence in Section 3 and clarify the transition from counterfactual evidence to the actual algorithm. Section 4.2 now presents the complete gradient-to-response mapping and explains the midpoint CDF, making the score construction self-contained. Supporting implementation details are provided in Appendix A.2.
[Q2] Selection of cells and Gaussians for masking
Response. RAGP masks spatially grouped Gaussians rather than randomly selected individual primitives. At the frozen 15K state, Gaussian identities are fixed and their normalized centers are partitioned into occupied Fine cells. Starting from the resolution whose occupied-cell count is closest to 128, we examine progressively finer grids under the frozen training-camera schedule.
A cell is eligible if it contains at least one Gaussian with positive screen-space radius and positive accumulated rendering contribution in at least one scheduled training view. We select the finest feasible resolution for which every eligible cell receives at least two actual Masked observations during 15.5K–20K. The scheduler prioritizes under-observed cells approaching their last visible opportunities.
For each selected cell-camera pair, all Gaussians within the cell are temporarily attenuated using a shared contribution-aware multiplier. The perturbed Gaussians are excluded from response aggregation; only Gaussians outside the selected cell serve as compensation responders. Normal and Masked branches share the same initial state and camera, while Masked computes read-only gradients and only Normal updates the model.
Revision. We clarified cell eligibility, adaptive resolution selection, temporary attenuation, and responder selection in Section 4.2, with supporting implementation details in Appendix A.1.