- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper applies the philosophy of ShortGPT's block-influence score to eight 3D foundation models and bypasses the K least influential blocks. On 208 indoor cells under a relative depth acceptance test, K=5 passes 94% of cells. A fixed set per architecture matches per-sequence re-scoring and a labeled single-block oracle is not statistically separated from it. The paper also reports four further findings with some experimental support.
Critical strengths
- As far as I know, this is the first cross-paradigm study of block pruning on 3D foundation models.
- The authors perform a lot of efforts to evaluate with statistics computation and designed controls.
Critical weaknesses
- The acceptance test does not certify the model. Of the 18 depth-accepted cells with a measured trajectory, 9 exceed 1.25× ATE. The instrument behind the 94% headline therefore fails on half of the cells that were audited. It also ignores pose, cross-view consistency and metric scale, which are what distinguish a 3D foundation model from a depth network.
- The title over-claims transfer. What transfers across models is the scoring procedure, not the block choice.
- The "94%" reflects the chosen K and threshold, not the selector. K=5 is exactly the largest K at which the weakest model still clears the 80% bar. On VGGT and π³, any 5 of the 8 safest blocks pass 100%. "Matching the oracle" is a ceiling effect at 94%, and on continuous metrics labeled greedy search does better.
- The baselines are weak versions of the defaults being tested. Last-K is evaluated without the healing step that the cited LLM finding relies on. Training-free linear replacement (ReplaceMe) is not evaluated at all, so Table 1's verdicts rest on these weakened versions.
- The practical payoff is small. K=5 saves 5.8–11.5% of wall-clock time, nothing measurable on the three pair models and no activation memory. In contrast, token merging alone saves 38% at V=64. Also all quality results are at V=4, where the bypassed global blocks matter least.
- There are no detailed comparisons with the existing efficiency methods for 3D Geometric Foundation Models. It would be interesting to see such evaluation results with some representative works (e.g. FastVGGT/Co-Me/LiteVGGT etc) qualitatively and quantitatively.
- Also this manuscript mainly tests on relatively old base models (e.g. VGGT) and a lot of more modern backbone networks (e.g. Depth Anything 3 or MapAnything) are not measured. This is important to the model generality capability.
Questions for authors
Please see the weakness part.