- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents Web2Earth, a framework for extending a web-pretrained vision encoder to remote sensing imagery. The approach jointly optimizes RGB self-distillation and two cross-modal losses. CMRD encourages SAR representations to reproduce the RGB teacher’s inter-scene similarity structure, while CoPaD matches teacher and student prototype predictions at corresponding patch locations. Initialized from DINOv3, the resulting model is assessed through frozen-encoder evaluations covering classification, segmentation, change detection, and scene retrieval.
Critical strengths
The study explores a useful alternative to large-scale remote sensing pretraining by adapting an existing web-trained model with relatively little additional data and a small number of backbone updates. Retaining optical performance while improving SAR representations is practically valuable, as is the ability to process either modality independently during inference.
The experimental coverage is broad, spanning multiple tasks, datasets, and SAR sensors not encountered during adaptation. Evaluations without task-specific encoder training help assess the transferability of the learned features. The same-data continual-pretraining baseline and separate evaluations of the two cross-modal objectives provide useful evidence that paired supervision contributes beyond additional training alone.
Critical weaknesses
The technical contribution appears incremental when viewed in the context of existing cross-modal representation learning. Learning non-RGB representations from paired RGB observations was established by Cross Modal Distillation for Supervision Transfer (CVPR 2016). Relational KD and similarity-preserving KD already motivate transferring relationships rather than absolute feature coordinates, and DistilVPR (AAAI 2024) applies relational supervision across image and point-cloud representations. Correspondence-based local transfer is also well explored in SLidR (CVPR 2022) and foundation-model adaptation methods such as EventSAM (CVPR 2024). CMRD largely follows this established similarity-matching paradigm, while CoPaD uses a conventional prototype-based distillation objective at spatially aligned locations. Although their integration is sensible, the paper does not adequately explain what methodological advance it introduces beyond adapting these familiar ingredients to optical–SAR data. The contribution therefore reads primarily as an empirical adaptation study.
Several central interpretations are not fully supported by controlled comparisons. In Table 5, the raw feature baseline excludes projection heads, whereas CoPaD introduces both projection heads and prototype-distribution matching. This comparison cannot determine whether the improvement comes from the proposed prediction-space objective or simply from allowing a learned projection. Moreover, matching within-modality similarity matrices does not by itself align the modalities for direct retrieval: CMRD permits orthogonal transformations of the student representations, but evaluation relies on cross-modal cosine similarities between CLS tokens. Component-level retrieval experiments are needed to explain how this ambiguity is resolved.
Questions for authors
Beyond their application to optical–SAR imagery, what substantive advances do CMRD and CoPaD offer over existing relational and spatial correspondence-based distillation methods? What are the individual contributions of CMRD and CoPaD to RGB-to-SAR retrieval?
2 comments
Thank you very much for your thoughtful follow-up and for carefully considering our additional experiments. Your comments helped us strengthen the experimental comparisons and clarify both the contribution and limitations of our approach. We sincerely appreciate the time and care you have devoted to reviewing our work. We will incorporate these additional results and clarifications into the revised manuscript. We hope the strengthened evidence helps convey the value of our central contribution: a simple, lightweight framework that extends a web-pretrained encoder to SAR while preserving strong optical transfer. Thank you again for the constructive discussion and for helping us improve the paper.
RE: Rebuttal
Thank you for the detailed responses and additional experiments. The projected-feature alignment control and component-level retrieval ablations substantially address my concerns about the experimental comparisons. I also appreciate the acknowledgment that CMRD does not guarantee cross-modal coordinate alignment. These additions strengthen the empirical evidence.