- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper adapts a frozen VFM for cross-view correspondence using a single overlapping image pair with correspondences derived from dataset depth/pose annotations, via a lightweight two-stage adapter: an attention-gated 3×3 convolution trained with patch-level contrastive loss, followed by a shared linear projection that aligns the two views' within-view pairwise distance matrices under a LogDet regularizer.
At test time the adapter is frozen and applied per-image with the unchanged cosine-NN matching pipeline, and since each run trains on one pair, the authors repeat on 10 sampled pairs and report the mean.
Critical strengths
None.
Critical weaknesses
-
The "3D correspondence" framing overclaims: no depth, camera parameters or geometric constraint ever enters the model, and the paper's own Table 2 shows an adapter trained on object pairs improves PF-PASCAL cross-instance semantic correspondence, which has no geometry at all.
-
The closest literature is missing — the training-free VFM/diffusion semantic/geometric correspondence line, such as A Tale of Two Features[1], DIFT[2], Telling Left from Right[3], DIY[4], VGGT Semantic[5], Motcha[6], MASt3R[7] and RoMa[8] is uncited. This reduces the technical reliability of this paper and is the biggest reason that I reject this paper.
-
A plain 3×3 convolution nearly matches the full method, and since DVT already showed that ViT features suffer from high-frequency artifacts that smoothing alone alleviates — and the paper's own Fig. 4 highlights "fewer artifacts" — the decisive control is missing: an untrained randomly-initialized convolution, or plain Gaussian blur; if those also help, the necessity of both the contrastive objective and the attention gate has to be re-examined.
-
Selecting adaptation pairs requires camera intrinsics and relative pose (0.4–0.6× FOV), Fig. 5 shows curves with no numeric values and no variance, and the paper never discusses how this geometric prior would be obtained at deployment.
-
In actual deployment, it is difficult to find image pairs suitable for one-shot learning.
[1] Zhang J, Herrmann C, Hur J, et al. A tale of two features: Stable diffusion complements dino for zero-shot semantic correspondence[J]. Advances in Neural Information Processing Systems, 2023, 36: 45533-45547.
[2] Tang L, Jia M, Wang Q, et al. Emergent correspondence from image diffusion[J]. Advances in neural information processing systems, 2023, 36: 1363-1389.
[3] Zhang J, Herrmann C, Hur J, et al. Telling left from right: Identifying geometry-aware semantic correspondence[C]//2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024: 3076-3085.
[4] Dünkel O, Wimmer T, Theobalt C, et al. Do it yourself: Learning semantic correspondence from pseudo-labels[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision. 2025: 5834-5844.
[5] Yang S, Wei T, Lan Y, et al. Towards Geometry-Grounded Dense Semantic Matching with VGGT Priors[C]//European Conference on Computer Vision. Cham: Springer Nature Switzerland, 2026: 586-605.
[6] Xue F, Elflein S, Leal-Taixé L, et al. MATCHA: Towards matching anything[C]//2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025: 27081-27091.
[7] Leroy V, Cabon Y, Revaud J. Grounding image matching in 3d with mast3r[C]//European conference on computer vision. Cham: Springer Nature Switzerland, 2024: 71-91.
[8] Edstedt J, Sun Q, Bökman G, et al. Roma: Robust dense feature matching[C]//2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024: 19790-19800.
Questions for authors
-
Why is the training-free VFM/diffusion correspondence line (especially, Telling Left from Right and MASt3R) neither cited nor compared, when it targets cross-instance semantic matching with no adaptation pair at all?
-
What is your concrete advantage over those training-free methods?
-
Your evidence is entirely sparse (R@5px, PCK at sampled keypoints via cosine-NN) and the adapter has no dense-specific design — no cost volume, no cost aggregation, no smoothness or multi-scale prior — so how do you verify that dense correspondence actually improves rather than just nearest-neighbor feature discriminability?