- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces DiveUp, a shared feature upsampler trained to reconstruct features from diverse vision foundation models while matching a local COM field from a spatially aligned teacher. It achieves competitive zero-shot performance on segmentation and depth estimation. An additional analysis relates the representational diversity of the training mixture to generalization.
Critical strengths
- The method shows strong zero-shot generalization to unseen backbones, especially those with noisy spatial features.
- It is a simple, model-agnostic way to transfer geometric structure without aligning heterogeneous feature spaces.
Critical weaknesses
- The paper frames the COM guidance as a central contribution, but its practical impact in the full pipeline seems relatively minor. Its benefit is mainly visible in single-backbone settings or boundary-specific metrics, so its role as a core component need to be established more clearly.
- The claim that mixture diversity drives generalization rests on a small number of mixtures. Since the effect of diversity is heavily confounded with the choice of model families, this conclusion lacks solid backing.
Questions for authors
- Could the authors clarify the contribution of the COM loss in the final multi-VFM configuration, ideally with results over multiple seeds?
- Is there additional evidence, such as mixtures that control for model family, supporting the relationship between mixture diversity and generalization?