- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates when foundation-model guidance can be removed during sparse feature matcher training. It proposes Foundation-to-Geometry Handoff (FGH), which aligns LightGlue's refined descriptors with projected DINOv2 features during COCO synthetic-homography pretraining, then removes the teacher for geometric fine-tuning on TUM RGB-D. The authors compare four guidance schedules (none, early-only, late-only, and continuous) using a shared-parent, two-seed experimental design. Results on HPatches and MegaDepth show improvements from early guidance, while continued supervision provides little additional benefit. Residual, gradient, and shuffled-target analyses are further used to examine this behavior.
Critical strengths
S1. The paper investigates whether foundation guidance can be removed after early training without sacrificing matching accuracy. This is practically relevant, as it could reduce subsequent training costs without changing the deployed matcher.
S2. The shared-parent 2×2 design provides a controlled comparison of different guidance schedules. The residual and gradient analyses further help explain why continued guidance may offer diminishing benefits.
Critical weaknesses
W1. Limited benchmark competitiveness. Tables 6–7 mainly compare against methods from 2017–2023, leaving recent advances in feature matching underrepresented. Moreover, FGH achieves only modest improvements over the retrained LightGlue baseline (+0.69/+1.04 percentage points on HPatches/MegaDepth mAA). Since these results are obtained under a specific COCO-to-TUM training protocol, the practical value of the proposed strategy in more competitive training settings remains unclear.
W2. Insufficient validation of the finite-lifetime claim. The experiments consider only a fixed teacher release point, without examining how release timing affects final performance. Moreover, the two stages differ in training data and optimization settings, making it difficult to separate the effect of guidance timing from the stage transition. Thus, the results support diminishing returns within this particular protocol but do not fully establish the claimed guidance lifetime.
Questions for authors
Q1. How does matching performance vary with different teacher release points? Does the same early-versus-late pattern hold under a single-domain, equal-budget training setup?
Q2. Does the observed saturation of foundation guidance persist under a standard, larger-scale LightGlue training protocol?
Q3. Since shuffled teacher features retain most of the performance gains, what evidence distinguishes foundation-specific knowledge transfer from general auxiliary regularization?