- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work builds on the previously published SFS and proposes performing feature refinement before fusion for feature lifting from 2D multi-scale SAM masks and OpenCLIP descriptors to 3DGS. The proposed approach utilizes all levels of SAM masks as a "Uniform" branch and the middle-level features as a "Mid" branch. In this pipeline, it first lifts the features from each mask level and combines them into the Uniform branch while retaining the middle level as the Mid branch from the lifted 3DGS. After the initial round of lifting features to 3DGS separately to form the Uniform and Mid branches, the method evaluates and refines the quality of the lifted 3D features by computing the IoU between SAM masks and rendered feature clusters from 3DGS across training image views. The authors then define a score to assess feature stability across views and ultimately determine how to fuse the Uniform and Mid branches into the final 512-dimensional feature vector for each Gaussian. The authors compare the proposed approach with other state-of-the-art methods on LERF and 3D-OVS.
Critical strengths
The proposed approach is practical; it retains the footprint of SFS, as discussed by the authors, and should be straightforward to integrate into existing processing pipelines where SFS is already adopted (I would personally test it in our own pipeline).
Critical weaknesses
-
The contribution of this work appears to be largely incremental over SFS (published at ICLR last year). SFS's primary contribution was providing a closed-form solution for feature lifting and proving an upper bound for it, with open-vocabulary segmentation serving as a validation method and post-lifting aggregation presented as an additional contribution. From my understanding, this paper applies post-lifting aggregation from SFS separately to the Uniform and Mid branches and introduces a fusion process at the end. Consequently, the reviewer is not convinced that the claimed contributions are substantial enough for ICLR.
-
The paper claims that "Refine Fuse" outperforms "Fuse Refine." While this trend holds across all four scenes in Table 8, the gain on the Ramen scene with the SFS backend is only 0.14. Such a marginal improvement could be attributed to variations in 3D reconstruction quality. Given that the authors already evaluated three different reconstructions in Table 1, it would be beneficial to extend the results in Table 8 across all three reconstructions.
-
Comparing Table 1 with Table 1(a) of the original SFS paper, the reported SFS baseline on LERF is 61.22, whereas the original SFS paper reported 65.1. The authors do not clarify the cause of this substantial discrepancy in their reproduction of SFS. This gap makes the claimed 7.34 gain of the proposed method less convincing.
-
The authors' choice of the Mid branch setting () is not adequately justified with an ablation study.
-
The paper misses several relevant related works, such as GAGS [1], THGS [2], and N2F2 [3], which also explore combining multi-granularity SAM masks in 2D/3D GS:
[1] Peng, Yuning, et al. "Gags: Granularity-aware feature distillation for language gaussian splatting." Proceedings of the AAAI Conference on Artificial Intelligence. Vol. 40. No. 10. 2026.
[2] Dai, Shaohui, et al. "Training-free hierarchical scene understanding for gaussian splatting with superpoint graphs." Proceedings of the 33rd ACM International Conference on Multimedia. 2025.
[3] Bhalgat, Yash, et al. "N2f2: Hierarchical scene understanding with nested neural feature fields." European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2024.
Questions for authors
-
Please provide experimental results and clarifications addressing the concerns raised in Weaknesses 2 and 4, and clarification for 3.
-
Please clarify and further articulate the primary novel contributions of this work relative to SFS.
-
Please incorporate and discuss the missing related works noted in Weakness 5.