- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a training-free distractor filtering method for a feedforward 3DGS model, which utilizes per-view Gaussian exclusion and cross-view distractor to identify the Gaussian components to be removed. Experiments conducted on various baseline models and two distractor benchmark datasets demonstrate that this method significantly improves the performance of novel views while causing only a limited decline in performance for clean inputs.
Critical strengths
This method provides a practical filtering process that does not require retraining or optimization for specific scenarios. Comparisons across multiple backbone networks and varying numbers of inputs show that this method achieves a consistent improvement in average performance across all datasets.
Critical weaknesses
-
Compared with simple differential-based filtering methods, the advantages of this approach have not yet been fully validated. Currently, there is a lack of benchmark methods based on fully reconstructed residuals, and as shown in Table 6, adding self-view filtering to cross-view filtering only improves the average PSNR by 0.15–0.18 dB.
-
Evidence regarding robustness is rather limited. The evaluation of noise-free scenes covered only four scenes, and the method’s sensitivity to thresholds and depth/opacity protection measures was not investigated.
Questions for authors
-
How does the method compare with full-reconstruction discrepancy filtering using the same features, validity conditions, and a comparable pruning budget?
-
How were the thresholds selected, and can threshold ablations clarify whether the reported gains and clean-scene preservation remain stable?
10 comments
W2 & Q2.
(W2) Evidence regarding robustness is rather limited. The evaluation of noise-free scenes covered only four scenes, and the method’s sensitivity to thresholds and depth/opacity protection measures was not investigated.
(Q2) How were the thresholds selected, and can threshold ablations clarify whether the reported gains and clean-scene preservation remain stable?
We use the same thresholds, τ_self = 0.5 and τ_cross = 0.05, for all models, datasets and input counts. They were chosen empirically from a few candidate values and then fixed. The table gives the change in PSNR on cluttered / clean inputs over a range of values with 4 inputs, averaged over the three models from our main experiments. Cluttered inputs cover the scenes of RobustNeRF and NeRF On-the-go, and clean inputs the four RobustNeRF scenes.
| τ_self \ τ_cross | 0.01 | 0.025 | 0.05 (ours) | 0.1 | 0.2 |
|---|---|---|---|---|---|
| 0.3 | +0.51 / −0.45 | +0.62 / −0.35 | +0.66 / −0.32 | +0.66 / −0.30 | +0.62 / −0.30 |
| 0.4 | +0.77 / −0.24 | +0.87 / −0.14 | +0.90 / −0.11 | +0.88 / −0.08 | +0.81 / −0.08 |
| 0.5 (ours) | +0.85 / −0.16 | +0.94 / −0.07 | +0.96 / −0.04 | +0.91 / −0.02 | +0.76 / −0.02 |
| 0.6 | +0.79 / −0.14 | +0.87 / −0.05 | +0.86 / −0.02 | +0.74 / 0.00 | +0.44 / 0.00 |
| 0.7 | +0.76 / −0.14 | +0.83 / −0.05 | +0.81 / −0.02 | +0.68 / 0.00 | +0.34 / 0.00 |
For the opacity condition, we changed its threshold and also removed it. The table gives the change in PSNR on cluttered / clean inputs in the same setting.
| self-view opacity threshold | removed | 0.1 | 0.3 | 0.5 (ours) | 0.7 | 0.9 |
|---|---|---|---|---|---|---|
| ΔPSNR (dB) | +0.97 / −0.04 | +0.97 / −0.04 | +0.97 / −0.04 | +0.96 / −0.04 | +0.95 / −0.03 | +0.92 / −0.02 |
For the depth conditions, we added a relative margin of ±5% and ±10% of the depth and also removed each condition.
| depth margin | removed | −10% | −5% | 0 (ours) | +5% | +10% |
|---|---|---|---|---|---|---|
| self-view depth | +0.80 / −0.05 | +0.92 / −0.04 | +0.93 / −0.04 | +0.96 / −0.04 | +0.97 / −0.04 | +0.97 / −0.04 |
| cross-view depth | −0.19 / −0.08 | +0.89 / −0.06 | +0.93 / −0.05 | +0.96 / −0.04 | +0.95 / −0.02 | +0.90 / −0.02 |
For self-view filtering, we also removed the opacity and depth conditions together.
| self-view conditions removed | none (ours) | opacity | depth | both |
|---|---|---|---|---|
| ΔPSNR (dB) | +0.96 / −0.04 | +0.97 / −0.04 | +0.80 / −0.05 | +0.07 / −0.80 |
Around our settings, the gains are stable and clean inputs remain close to the unfiltered results. The conditions are needed as a whole. Removing the cross-view depth condition, or both self-view conditions, loses most of the gain.
We also evaluated 12 more distractor-free scenes from Mip-NeRF 360 and Tanks and Temples. The table gives the change in PSNR averaged over the same three models.
| 4 inputs | 8 inputs | 16 inputs | |
|---|---|---|---|
| RobustNeRF, 4 scenes | −0.04 | −0.01 | +0.06 |
| Mip-NeRF 360, 6 scenes | −0.07 | −0.01 | +0.06 |
| Tanks and Temples, 6 scenes | 0.00 | −0.01 | +0.11 |
Quality is largely preserved on all three datasets. We have added these results to the paper.
Thank you for the additional experiments. The robustness results address my second concern. Could you clarify which depth validity checks were applied to the full-rendering baseline?
W1 & Q1.
Thank you for this constructive suggestion. The paper states that the discrepancy between renderings and inputs can be obscured in the feed-forward setting, but we did not support this with an experiment.
We tested the baseline you describe, which compares each input with the rendering of all Gaussians, as optimization-based distractor-free methods commonly do. It uses the same features, opacity condition and pruning budget as our method. We also report its best single threshold, and our self-view path alone under the same budget. We have added this comparison to the paper. The table gives the change in PSNR averaged over the three models from our main experiments.
Regarding the gain from adding self-view to cross-view filtering, both paths build on the same idea of using the per-view Gaussian association to expose inconsistency across views. They examine a view’s Gaussians from that view’s camera and from the other input cameras, respectively, so their selections naturally overlap in part. Combining the two signals consistently gives the best results.