- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes LGPcd---a remote sensing change detection framework that combines LLM-derived semantic priors (text), shared dictionary representations, and progressive SAM-based refinement to recover accurate results. Evaluations on LEVIR-CD, SYSU-CD, and SECOND show superior performance compared with the reported baselines.
Critical strengths
Incorporating LLM knowledge as textual semantic priors is intuitive and reasonable, and SAM-based refinement is technically well motivated. Both components yield substantial performance gains across the evaluated remote sensing change detection benchmarks (e.g., LEVIR-CD, SYSU-CD, and SECOND).
However, the current manuscript does not sufficiently establish the necessity and effectiveness of the proposed component, for the weaknesses outlined below.
Critical weaknesses
I outline the weaknesses that limit the paper’s completeness; listed in descending order of importance.
[Missing Ablation on Text-Guided Enhancement] The authors claim that the semantic information in the text descriptions can improve performance by providing a global semantic prior (L176). While this approach is reasonable, the authors do not provide a concrete ablation that isolates the contribution of text guidance (which is important given that the paper’s main contribution lies in “LLM-Guided” and “Progressive” remote sensing change detection). Similarly, I believe "Progressive" ablation should include an N=1 baseline. This comparison is necessary to distinguish the benefit of introducing progressive refinement from that of not using refinement at all.
[Missing SAM-based baselines and Efficiency Analysis] Table 1 excludes the closely related SAM-based methods discussed in Related Work. These comparisons are particularly necessary because the proposed approach also relies on SAM. Moreover, the proposed method applies SAM multiple times through progressive processing (where inference cost can be substantially higher than that of conventional change detection models). Therefore, an efficiency analysis is needed to assess the effects of the SAM model size and the number of progressive iterations on inference time, computational cost, and memory usage, ideally in comparison with other SAM-based methods.
[Insufficient Detail and Poor Reproducibility] The paper misses essential details---including the LLM version/settings, the text encoder used to encode the LLM-generated text, the SAM variant, which components are trainable or frozen, and a detailed description of the model architecture (e.g., dictionary, coefficient encoder). It also lacks a reproducibility statement; in my point of view, the information provided in the current manuscript is highly insufficient to reproduce the reported quantitative results. This constitutes a critical weakness that should not be overlooked.
[Missing Analysis on Error Accumulation] Recent benchmarks show that even frontier Multimodal LLMs (MLLMs) can incorrectly describe changes in remote sensing image pairs [1]. However, the paper assumes the LLM’s outputs are always reliable and does not examine whether errors propagate to the final predictions or are corrected through progressive refinement. To ensure the paper's completeness, analysis of the erroneous LLM outputs is essential.
[Formatting and Typo] Current citations in the Introduction appear without the parentheses required by the ICLR citation guidelines; authors should use \citep{} instead of \cite{}. Figure 1(a) also contains “Trantional,” which should be corrected to “Traditional.”
[1] C3-Bench: A Context-Aware Change Captioning Benchmark
Questions for authors
Please refer to the Weakness section.
I currently lean toward a Clear Rejection in its current form. Yet, if the authors can satisfactorily clarify and address the weaknesses outlined above, I would be happy to reconsider the assessment during the discussion period.