- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper builds upon the static 3DGS probing framework of Feat2GS (CVPR 2025) and extends it to dynamic scenes (Deformation mode) and semantic segmentation (Semantic mode), collectively termed Feat4DGS. Using this setup, the authors evaluate 14 frozen VFMs across 5 layer depths (P10, P50, P80, Penultimate, Final) and 5 dense tasks, concluding that a non-final layer strictly outperforms the final layer in 64 out of 70 comparisons and that optimal depth is model- and task-dependent.
Critical strengths
- Standardized Large-Scale Evaluation: The paper standardizes model capacity (~300M ViT-L checkpoints) and feature dimensionality across 14 diverse VFMs, providing a thorough layer-wise evaluation that was missing in the original Feat2GS paper.
- Objective Qualitative Selection Protocol: The median-based automated view selection protocol in Appendix A.3 is well-designed and avoids subjective cherry-picking.
Critical weaknesses
-
Limited Fidelity and Signal-to-Noise Ratio in Dynamic and Semantic Extensions: Compared to the clean static probes (G, T, A) inherited from Feat2GS, the two newly introduced extensions appear to face representation bottlenecks and optimization noise. In Dynamic mode, the best PSNR across all 14 VFMs falls within a narrow, low-fidelity band of 16.96--17.51 dB and $\sim$0.50 SSIM (range of 0.015), with noticeable visual blurring and tearing (Figs. 2a,). Because image VFMs lack temporal priors, the shallow MLP may primarily be fitting the timestamp under noisy Easi3R poses. Moreover, optimal layers often shift across metrics (PSNR vs. LPIPS, Table 6), suggesting that small layer-wise variations ($\sim$0.03--0.2 dB) might reflect optimization noise rather than motion representation quality. In semantic mode, projecting features onto 3DGS introduces coarse alpha-blending artifacts and boundary bleeding (Figs. 2b). Quantitatively, the layer-wise sensitivity is quite modest: the median gain over Final is only +0.45% mIoU, with 10/14 models showing variation (Table 3).
-
Scope and Standalone Contribution Relative to Feat2GS: Because the dynamic and semantic probes exhibit relatively low signal-to-noise ratios, the most compelling empirical findings still stem from the unchanged static G/T/A pipeline on the same 6 scenes from Feat2GS. Thus, the core validated contribution functions largely as a layer-wise extension of Feat2GS. While highlighting layer-selection sensitivity in Feat2GS is a useful observation, the effective methodological expansion beyond Feat2GS feels somewhat incremental for a standalone paper.
-
Potential Confounding Factors in the Layer-Wise Evaluation: First, the "64/70" statistic compares the maximum over 4 candidate layers on test views against 1 fixed layer (Final) without a validation split. As shown in Tables 5 and 6, a model's optimal layer varies considerably across individual scenes and metrics; without a single intermediate layer that generalizes consistently across unseen scenes, post-hoc selection may introduce a positive bias. Second, compressing all layers to 256-dim via PCA and using a 2-layer MLP makes it difficult to disentangle intrinsic feature quality from probe capacity, as fixed-rank PCA and a shallow MLP may struggle to unpack the non-linear transformations in deeper ViT layers.
Questions for authors
-
If the intermediate layer for each model is selected via leave-one-scene-out cross-validation (rather than post-hoc test selection) and evaluated with a modest tolerance threshold (e.g., , ), in how many of the 70 cases does the chosen non-final layer still outperform Final?
-
Given the $\sim$17 dB PSNR baseline in Dynamic mode and the 0.45% median mIoU gap in Semantic mode, how can we best distinguish genuine representation differences from optimization variance? Also, how does the 3DGS semantic probe compare to direct 2D pixel-wise linear probing on the same views?
-
What is the explained variance ratio retained by the 256-dim PCA at P10 vs. Final? How does a multi-layer fusion baseline (P10+P50+P80+Final followed by PCA) perform relative to the best single layer and the Final layer?