- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper identifies 2 limitations of current CD architectures, namely 1/ the fact that pretrained vision backbones compress too much the information, leading to difficulties when it comes to detecting tiny changes; and 2/ the fact that current models tend to cross information between the images already during encoding through the interaction of features extracted from the two images, and while this can help carry structural changes it can also carry irrelevant variations like illumination or seasonal differences. The paper makes 2 main contributions: First, they make a study of how and when does crossing information between the two images help. The study shows that the benefits depend on the information being exchanged: with raw differences and pair-mean appearance, cross information during the encoding stage hurts performance, while normalization helps stabilizing the information agains noise, and replacing the pair mean by channel-wise agreement increases change selectivity. Second, they introduce RIFT-CD, a CD model build on an adapted DINOv3 model that uses these results and preserves high-resolution features to answer the two limitations above, achieving SOTA performance.
Critical strengths
- The main comparison/ablation for cross-temporal feedback is interesting. In particular the factorial design (Table 3) is valuable.
- The “S-R-F” (=Stride-2 stem instead of Stride-4 to increase resolution, Normalized relation and temporal feedback) decomposition is clear.
- Honest reporting, including the costs that come with every update (e.g. 3.75x compute when using a Stride-2 stem instead of Stride-4, etc)
- Tested robustness against radiometric perturbations
- Measuring message drift and update selectivity help understanding, beyond general F1 performance, the impact of each component.
Critical weaknesses
-
Modest novelty: It seems like every ingredient (feature interaction in the encoder à la Changer, backbone, descriptors) already exists in the literature. The contribution is the combinaition of those ingredients and the associated justification. As underlined in the contributions listed in the introduction, the main contribution of the paper is the study of the importance of the crossed information/feedback. The RIFD-CD architecture is merely the resulting architecture that arise from the conclusion of this study, plus some additional tweaking of the backbone strides to increase the resolution. The model, as it is, does therefore not bring much novelty. The study, however, does! But unfortunately, the latter is reduced to a single dataset, LEVIR-CD, and a single architecture. What happens for example with other pretrained encoders? Other types of CD architectures? Other images from other datasets with different observable objects/scenes and different resolution? The paper could be very interesting if more general and generalizable, yet all the interesting results are only provided on a single dataset with a single architecture. The claim is general, but not proven, and this is a major weakness of this work.
-
Robustness is only tested with synthetic perturbations. What about real distributions shifts?
Things to improve the paper that did not impact the score:
- The notation in Figure 1 can be a bit confusing. You denote S,R,F the different factors but S is for example already used for the outputs of the RC module. Similarly, the colors are not consistent, S is in blue and so are the features of the first image, but F is in orange like the features of the second one. It could be nice to have a clear color code to make the different factor visually clear. You could also add Ht, Ft, al, bl or Xl in the figure to help the reader understand the methodology.
- Where is the normalization applied? It is not clear in the paper. Is it before computing the descriptors?
- Some notations could be better introduced, as some are never defined. What is m_l in line 375 for example? The definition is, if I am not wrong, only in the supplementary materials.
General assessment: The paper asks a great question which is when and how does feature interaction help change detection in remote sensing. The paper is rigorous and the comparisons (factorial design) are well constructed and interesting, yet the scope of this work is narrow. The central findings come from only one dataset, one architecture, one interaction mechanism, despite the claim being general. The only thing that is demonstrated is that the conclusion holds in this configuration. And without this stronger analysis, the resulting RIFT-CD seem incremental. The architecture can be understood as an output to the study, rather than an independent contribution (which is fine!!) but in that case the study needs to be stronger and more general.
Questions for authors
See Weaknesses
2 comments
Dear Authors,
I acknowledge your rebuttal. Unfortunately, since it was posted shortly before the end of the discussion period, I may not have time to carefully review your responses and provide further constructive feedback before the end of the discussion period.
I will, however, consider your responses during the reviewers/AC discussion.
Best regards,
Critical Weaknesses
CW1. Novelty and generality of the mechanism study. We agree that the individual components of RIFT-CD are not claimed as fundamentally new architectural primitives. Rather, the central contribution of this work is a controlled investigation of how relational evidence affects the utility of cross-branch temporal feedback. Specifically, our factorial design isolates the interaction between evidence completeness (Raw vs. Full) and feedback direction (Self vs. Cross), allowing us to examine whether relational evidence changes the relative effectiveness of cross-branch feedback beyond what can be achieved through self-context feedback alone. RIFT-CD is the resulting architectural instantiation of these findings, rather than the sole source of novelty.We have expanded the study along all three dimensions you requested.
1. Other pretrained encoders. LEVIR-CD held-out test F1 (%):
Full-Cross improves over Full-Self on all three added encoders. The Full-versus-Raw feedback interaction, (Full-Cross − Full-Self) − (Raw-Cross − Raw-Self), is positive for ConvNeXt-T, Swin-T and ConvNeXt-V2-T: +0.079/+0.044/+0.255 F1 pp, respectively. For ConvNeXt-V2-T, enabling feedback also improves over the feedback-disabled control by +0.642 F1, +1.092 IoU and +0.721 Boundary-F1 pp; Swin-T improves all three metrics as well.
2. Other CD architectures and datasets. We integrated the normalized directed-feedback adapter into Siamese U-Net and Changer. Held-out test comparisons against each original architecture are:
On MineNet, Siamese U-Net Cross also exceeds the strong self-context control by +1.201 F1 and +1.340 IoU pp. These results demonstrate portability to two additional CD architectures and a new dataset.
3. Replicated mechanism evidence. On S2Looking, Full-Cross improves over Full-Self by +0.288 ± 0.337 F1 and +0.310 ± 0.237 Band-F1 pp (paired mean ± sample SD). S2Looking adds different scenes, viewing geometry and spatial resolution. Full is the only evidence arm with positive mean feedback gains in both metrics. Full also reduces radiometric/noise message drift at all three feedback levels in every seed on both datasets.
The additional SYSU-CD test gives Full-Cross 86.074 F1, 75.553 IoU and 64.323 Boundary-F1, improving over Full-Self by +0.057/+0.087/+0.285 pp. The expanded evidence connects the mechanism analysis to gains across encoders, architectures and datasets.
More importantly, the SYSU-CD factorial comparison shows that Raw-Cross decreases F1 by 0.1667 pp relative to Raw-Self, whereas Full-Cross improves F1 by 0.0567 pp. This yields a positive interaction of +0.2234 F1 and +0.3431 IoU pp across three seeds, further supporting the importance of complete relational evidence for cross-branch feedback.
CW2. Real distribution shifts. We added complementary evaluations on real imagery. Source-only cross-dataset transfer. Models use source-validation checkpoints and threshold 0.5, with no target fine-tuning, checkpoint selection or threshold tuning. F1 (%) is mean over three seeds:
These evaluations extend the robustness evidence to naturally occurring appearance changes and unseen target datasets.
Things to improve the paper that did not impact the score
Notation and colors. The symmetric change state is Tl; S,R,F denote design factors. Neutral factor tags and consistent blue/orange temporal branches distinguish these roles; labels Xlt,al,bl,Ht,Ft connect the figures to the equations.
Normalization order. Channel-wise L2 normalization N(x)=x/max(∣x∣2,10−6) is applied at each spatial location to projected features and attention outputs before constructing Dl=∣aˉl−bˉl∣, Cl=∣cˉlA−cˉlB∣ and Al=aˉl⊙bˉl.
Message definition. The main text defines mlA=Ψl([aˉl,cˉlA,Dl]), ulA=λl⊙mlA and XlA=XlA+ulA at first use; branch B is symmetric.