- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper formulates candidate localization in multispectral satellite imagery as similarity retrieval using self-supervised patch representations. Given a query exemplar, the method retrieves similar patches and combines their spatial metadata with similarity filtering and spatial aggregation to generate candidate regions. The experiments examine retrieval behavior, stability, sensitivity to inference parameters, and computational cost.
Critical strengths
The overall design is conceptually reasonable: retrieving similar patches and using their spatial metadata to generate candidate regions provides a natural connection between visual similarity and localization. This offers a plausible approach to exploring localization when bounding-box annotations are scarce.
Critical weaknesses
-
The experimental evidence is insufficient to substantiate the localization and repeatability claims. The evaluation primarily reports embedding similarities, candidate counts, retrieval overlaps, and search timings. Without independent target annotations or another validated assessment of semantic correctness, these measurements do not establish whether the retrieved regions contain the intended objects. The paper also provides no matched RGB-only baseline, alternative representation-learning baseline, or evaluation on an annotated benchmark, leaving the contribution of the proposed representation unestablished. Moreover, the abstract's claim of repeatable retrieval-based localization is difficult to reconcile with the reported results: horizontal flipping yields an agreement of only 0.1297 and a zero-match rate of 43.44%, while the median Jaccard@100 between same-class queries is zero. These results require a substantially more qualified interpretation. Overall, the experiments characterize the behavior of the pipeline but do not provide sufficient evidence for its effectiveness as a localization method.
-
The writing, figures, and treatment of prior work make the method difficult to follow and its contribution difficult to assess. The manuscript contains imprecise and internally inconsistent descriptions. For example, Section 4.2 specifies a projection head of 2048 → 2048 → 128, whereas Table 1 lists 2048–128–128. Section 8 states that “the number of candidates retrieved influences the number of candidates retrieved,” which does not communicate an interpretable finding. Figure 1 is crowded with small text, while the experimental figures and their brief captions provide limited guidance for interpreting the results and connecting them to the paper's claims. Several experimental figures and tables, including Figures 3–5 and Table 2, are not explicitly referenced in the main-text discussion, making it difficult to connect the narrative to the corresponding results and follow the experimental analysis. The related-work section largely summarizes a small set of general representation-learning and search components, without adequately comparing the proposed pipeline with prior exemplar-based retrieval and localization methods. Citation accuracy also needs attention: Section 2.1 attributes the MoCo-v2 improvements to Chen et al. (2020a), although the corresponding reference is Chen et al. (2020b). Together, these issues go beyond surface-level editing: they impede understanding of the implemented method and assessment of what is contributed beyond established components.
Questions for authors
-
What evidence supports the semantic correctness of the localized candidates, beyond high embedding similarity and retrieval overlap? If any independently checked examples or quantitative validation were collected, please identify them and explain the assessment protocol.
-
What configuration was actually used for the reported experiments? In particular, please resolve the projection-head discrepancy between Section 4.2 and Table 1, and provide the class-specific similarity thresholds and the procedure used to select them. How were these thresholds established without target annotations, and why do all tested threshold offsets produce exactly the same candidate count and mean score?
-
Which specific methodological elements distinguish this pipeline from existing exemplar-based retrieval and localization approaches? Please clarify the closest relevant methods and whether any comparisons with them were performed but omitted from the submission.
4 comments
Response to Question 1: Semantic correctness of retrieved candidates
We thank the reviewer for identifying this important distinction. We agree that high embedding similarity and retrieval consistency alone do not establish the semantic correctness of the generated candidate regions.
In our evaluation setting, the available annotations are used to construct class-specific query exemplars, whereas independent ground-truth annotations for the 40 target images are unavailable. Consequently, we cannot independently verify whether each retrieved candidate contains the intended object. We have not conducted a separate, systematic human verification study or quantitative target-object localization evaluation. The visual inspection performed during heuristic threshold selection was intended to guide parameter selection and should not be interpreted as an independent correctness assessment.
The quantitative experiments in the manuscript measure different aspects of retrieval behaviour. The similarity-distribution analysis characterizes embedding relationships; the spatial-concentration analysis examines the distribution of retrieved patches across target images; and the perturbation and multi-query consistency experiments measure retrieval repeatability. In particular, matching candidate boxes between original and perturbed queries measures consistency between two retrieval outputs, not agreement with target-object ground truth.
We have therefore clarified the scope of the claims. Each generated box represents the spatial footprint of a retrieved gallery patch, mapped using its stored image identity and coordinates, rather than an independently predicted or verified object boundary. The method is consequently more accurately described as retrieval-based spatial candidate generation (or candidate localization), rather than a ground-truth-validated object detector.
We acknowledge that independently annotated target subsets and a predefined human-assessment protocol would be necessary to establish semantic correctness. We identify these as important directions for further evaluation.
Response to Question 2: Implementation configuration and similarity thresholds
We thank the reviewer for identifying the configuration discrepancy and the need to clarify the threshold-selection procedure.
Projection-head configuration. The implemented projection head maps the 2048-dimensional ResNet-50 backbone representation through a 2048-dimensional hidden layer to a 128-dimensional embedding, with Batch Normalization and ReLU between the projection layers. Thus, the correct configuration is . The previously reported entry in Table 1 was an inadvertent formatting/transcription error during final manuscript preparation. We have corrected Table 1 and clarified the architecture description in Section 4.2 to ensure consistency with the implementation.
Threshold selection. The class-specific thresholds were selected heuristically through iterative trial-and-error and visual inspection of retrieved candidates. The query-chip annotations were used to define the eight query classes and construct their exemplars. However, the thresholds were not optimized or calibrated against independent target-image annotations, which were unavailable. The original thresholds and the complete class-wise score distributions are now reported in Appendix D.
Explanation of unchanged threshold offsets. We audited the Top-500 similarity scores for all 261 query chips, producing 130,500 query-gallery matches. The minimum observed similarity across all matches was 0.995068, whereas the maximum threshold tested under the offset was 0.60. Therefore, every retrieved match passed all the original thresholds and tested offsets. The threshold comparison was executed, but the selected cutoffs were non-binding over the observed score distribution. Consequently, the unchanged candidate count and mean score do not indicate threshold robustness; they result from thresholds that were overly permissive relative to the observed similarities.
To investigate sensitivity at the actual score scale, we added a class-wise percentile-based threshold analysis. At the 90th-percentile setting, the final candidate count decreases to 5,316, compared with 13,288 under the original thresholds. At the 95th percentile, 3,359 candidates remain. The complete threshold values, score distributions, candidate counts at successive inference stages, and spatial-coverage visualizations are provided in Appendix D.
We emphasize that the percentile-based settings characterize candidate-generation sensitivity and are not interpreted as calibrated confidence thresholds or optimal localization thresholds. Without independent target annotations, their effect on localization correctness cannot be established.
Response to Question 3: Methodological distinction from existing approaches
We thank the reviewer for requesting a clearer explanation of the methodological distinction and its relationship to existing exemplar-based retrieval and localization approaches.
We agree that the individual components of our pipeline, including contrastive representation learning, similarity search, FAISS indexing and non-maximum suppression, are established techniques. Our contribution is not to introduce a new similarity-search algorithm or a new detection architecture, but to investigate their integration for retrieval-driven spatial candidate generation in four-channel multispectral satellite imagery.
The distinction lies in the way the learned representation is used. Rather than generating region proposals through a separate detection network and subsequently classifying them, our framework constructs a gallery of overlapping multispectral patches. Each gallery embedding retains its source-image identifier and spatial coordinates. A query exemplar is embedded in the same representation space, and exact FAISS inner-product search retrieves the Top- most similar gallery patches. Their stored metadata maps them back to spatial candidate regions, which are subsequently processed using class-specific filtering and non-maximum suppression.
We have further clarified the relationship to representative few-shot detection approaches. For example, Li et al. (2022) employ a YOLOv3-based meta-feature and feature-reweighting framework with a bounding-box prediction module. Bou et al. (2024) use a two-stage detection architecture in which pretrained visual features and class-reference prototypes classify region proposals. In contrast, our approach performs direct patch-level nearest-neighbour retrieval and spatial recovery from gallery metadata, without a separate region proposal network, prototype classifier or bounding-box regression head.
We also clarify that no direct empirical comparisons against these methods, a matched pretrained RGB/NIR retrieval baseline, or a weakly supervised detector were performed and subsequently omitted. The current study is therefore not intended to establish comparative superiority over existing detection approaches. We have strengthened the Related Work and Limitations sections to make this distinction and the absence of comparative evaluation explicit.
Accordingly, we position the contribution as a retrieval-based framework for spatial candidate generation in multispectral satellite imagery, and not as a replacement for or a quantitatively superior alternative to established object detectors.
Response to Weakness 2: Presentation, Consistency, and Related Work
We thank the reviewer for identifying these weaknesses. We have carefully revised the manuscript to improve the technical clarity, positioning with respect to prior work, and overall presentation.
1. Improved positioning and comparison with related work. We agree that the initial version of Section 2 did not sufficiently distinguish our approach from existing representation-learning and localization methods. We have substantially revised this section. Section 2.1 now explains the distinction between conventional supervised classification pipelines, which use classification heads to produce categorical predictions, and our approach, which retains intermediate feature projections to construct an embedding space for exemplar-based retrieval. Section 2.3 further clarifies the distinction between dense prediction approaches and our retrieval-based framework. In particular, we explain how associating gallery embeddings with their source-image identifiers and spatial coordinates, together with FAISS-based similarity retrieval, enables retrieved patches to be mapped into spatial candidate regions without training a bounding-box prediction head. These revisions provide a clearer explanation of the methodological motivation and the specific role of spatial metadata in our framework.
2. Correction of the implementation configuration in Table 1. We identified a discrepancy in the projection-head dimensions reported in the original Table 1. The previously reported configuration, �0�, was an inadvertent formatting/transcription error introduced during the final preparation of the submission. The actual implemented architecture uses a two-layer projection head with dimensions �1�, mapping the 2048-dimensional backbone representation through a 2048-dimensional hidden layer to the final 128-dimensional embedding. We have corrected Table 1 to reflect the implemented architecture and checked the configuration for consistency with the method description.
3. Expanded Discussion and Limitations. We have revised Section 8 to provide a clearer interpretation of the experimental findings and a more explicit discussion of the study's limitations. The revised section distinguishes retrieval behaviour and repeatability from verified localization accuracy, acknowledges the absence of independent target-image annotations, and clarifies the limitations of evaluating a single four-channel ResNet-50 momentum-contrastive representation. We also identify the need for matched RGB-only comparisons, alternative self-supervised objectives and architectures, and evaluation on publicly annotated multispectral benchmarks.
4. Manuscript presentation and cross-referencing. We have also reviewed the manuscript for presentation and consistency. Figure and table captions, numbering, and in-text references have been checked and corrected where necessary. We have additionally reviewed the in-text citations against the reference list and corrected citation and formatting inconsistencies. The supplementary appendices have also been organized to provide additional mathematical, implementation, and experimental details.
We appreciate the reviewer’s constructive feedback. These revisions have helped us improve the clarity of the methodological contribution, ensure that the reported implementation configuration accurately reflects the actual model, and present the scope and limitations of the study more transparently.