- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes BridgeView, a cross-view representation enhancement framework for vision foundation models that aims to improve cross-view consistency without relying on intermediate 3D scene reconstruction or rendered feature teachers. Given calibrated RGB-D image pairs, BridgeView first constructs reliable same-surface correspondences and directly uses the frozen descriptor from the opposite view as the supervision target. To improve the reliability of this pair-based supervision, the method further introduces a bounded instance residual to mitigate mixed-instance token contamination and relation gradient coordination to reduce inconsistent updates among samples sharing the same instance relation. Experiments on indoor RGB-D benchmarks and DINO-family backbones show that BridgeView improves cross-view correspondence, semantic segmentation, visual localization, and TSDF map rendering, while achieving substantially lower training cost than reconstruction-based methods such as SnD; scaling the training corpus to 3M pairs further improves correspondence performance.
Critical strengths
BridgeView replaces the commonly used reconstruction-and-rendering pipeline with direct supervision from frozen opposite-view descriptors on geometrically certified same-surface pairs. This design is conceptually simple yet effective, and avoids the additional complexity introduced by intermediate 3D scene representations and rendered feature teachers.
The method consistently improves cross-view correspondence and semantic transfer across different DINO backbone sizes, including DINOv3-7B, and also demonstrates gains on visual localization and TSDF map rendering. The evaluation therefore provides relatively broad evidence that the learned cross-view consistency transfers beyond the direct correspondence objective.
By removing scene reconstruction and feature rendering, BridgeView substantially reduces training cost compared with prior methods such as SnD. The reported experiments show over training speedup, lower memory consumption, and continued performance improvements when scaling the training corpus to 3M view pairs.
Critical weaknesses
The paper claims that BridgeView makes two observations of the same surface share a descriptor in the pretrained coordinate system. However, the current evaluation mainly demonstrates improved correspondence accuracy rather than directly measuring the similarity between the learned student descriptors across views. Since the training objective supervises each student feature with the frozen descriptor from the opposite view, it remains unclear whether the learned representation is genuinely view-invariant or whether the model could learn view-dependent transformations between paired observations. A direct analysis of student-to-student feature consistency would make this central claim more convincing.
The paper attributes BIR to correcting mixed-instance token contamination and RGC to reducing gradient disagreement or variance within an instance relation. However, there is no subgroup analysis based on token occupancy or boundary mixing, nor any direct measurement of gradient variance/alignment before and after RGC.
The experiments are restricted to the DINO family of vision foundation models. Although BridgeView performs consistently across different DINO backbone scales, other foundation-model families are equally important and may possess different feature geometries. It would therefore be valuable to verify whether BridgeView remains robust and effective on other representative foundation models, rather than being specific to DINO-based representations.
Questions for authors
For a certified pair , BridgeView supervises each student readout using the frozen descriptor from the opposite view, i.e., $ z_i^a = R(Z^a,u_i^a) \rightarrow p_i^a = \mathrm{sg}!\left(R(\bar{Z}^b,u_i^b)\right), $ and symmetrically for view , with the final supervision applied to the BIR-refined target . I would appreciate some clarification on why this symmetric frozen-target formulation leads to a genuinely shared cross-view representation, rather than learning view-dependent mappings between paired observations. For an individual pair, the two directional objectives do not explicitly enforce . Is the desired cross-view invariance expected to emerge primarily from the shared encoder parameters together with the large number of overlapping same-surface pairs?
The paper motivates BIR as addressing mixed-instance token contamination and RGC as reducing gradient disagreement or variance within an instance relation. However, the current ablation mainly shows that adding these components improves downstream performance, without directly verifying the proposed mechanisms. Could the authors provide more direct evidence that BIR indeed benefits samples with stronger token mixing or boundary ambiguity, and that RGC actually reduces gradient variance or improves gradient alignment within the same relation group? Such analyses would help clarify whether the observed gains arise from the intended mechanisms rather than from more general regularization effects.
Response to the No.7130 author
Thank you for your response; my confusion has been resolved, and I will maintain my positive rating.