- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
In this paper, the authors propose GeoCircuit, a training-free method, to build task-specific subnetworks of 3D foundation models by removing attention heads from both frame and global attention. It uses the dense model’s own predictions as label-free targets and then a second-order approximation that accounts for interactions between heads estimates how much removing a group of heads would hurt each task. Given a head budget, the method selects which heads to keep for a requested task or set of tasks and packs them into a smaller network without fine-tuning. The paper reports better pose and point-map accuracy with superior efficiency over some baselines.
Critical strengths
- Generally, I think the paper is well-written and is easy to follow.
- The proposed GeoCircuit idea is cheap and easy to adapt. From the presented results, it generalizes to several different datasets and backbone networks.
- The task to address is important. How to more efficiently perform 3D reconstruction could be important to a lot of down-streamed applications.
Critical weaknesses
- Some baselines are missing. FastVGGT and AVGGT are cited but not compared while Co-Me (CVPR 2026) and LiteVGGT (CVPR 2026) are not cited at all. The closest head-pruning method, Kwon et al. (2022), is also missing. Since head removal is orthogonal to token reduction, both matched-latency comparisons and combined results are needed. More advanced variants (e.g. GoToHunt) are also welcome to compare with.
- Comparison is not compute-matched. HeSS, the only accuracy baseline, counts kept attention blocks rather than kept heads. So equal “retention” does not mean equal compute and Appendix I concedes this.
- The evaluation testbeds are limited. Currently, only Co3Dv2 and DTU are used, omitting standard protocols such as RealEstate10K, ScanNet-50, NRGBD and ETH3D. Depth and the multi-task objective (Eq. 12) are never evaluated. Accuracy is measured only on short inputs, while latency is reported at 100 frames.
- The experimental gains are limited. At 80-90% retention, GeoCircuit is near parity with HeSS. And on Pi-3, it trails HeSS on DTU at 70-90%. At 50% it still loses about 7 AUC@30 and ~40% in CD relative to dense for only a 1.6-1.8× speedup. The benefit of modeling head interactions over the diagonal-only variant is also inconsistent across retention ratios.
- The conceptual novelty is somewhat limited. Second-order head-mask pruning, random-projection curvature estimation and Hessian damping are established. And HeSS already uses Hessian-based head sensitivity on VGGT. The “circuit” framing adds little mechanistic analysis beyond pruning heads.
- Sec. 3.3 describes choosing \alpha on a validation set but the experiments fix \alpha = 0.5 based on Table 1, which uses test results. The same 50% setting also differs between Tables 1 and 2 (86.94 vs. 87.15 AUC@30), and no variance is reported.
Questions for authors
Please see the weakness part.
Official Comment by Reviewer DDfX
Thank you for the detailed response. The RFP comparison and new results on RealEstate10K, ETH3D, and KITTI address some of my concerns. However, I remain concerned about how GeoCircuit compares with other efficient VGGT methods.