- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies why frozen foundation models lose performance when remote sensing products change in resolution, radiometry, or processing level, and how to repair these failures without retraining the model. CALIPER uses clean source data to estimate normal feature variation, decides whether a correction is warranted, and determines the correction amount for each image. Its central goal is to recover predictions affected by product shift while preserving those that were already correct.
Critical strengths
- The problem and evaluation perspective are practically meaningful. Adaptation methods often emphasize improvements on degraded data, although deployed systems may receive both clean and affected images. I appreciate that this paper examines both corrected errors and newly introduced errors, alongside changes in class composition and arrival order. This makes the evaluation relevant to deployment concerns.
- The experiments support the main design choices. CALIPER uses normal variation in clean data to control correction strength and adjusts individual images rather than applying the same correction to an entire batch. The results show useful recovery with little disruption to clean predictions, while the ablations support the importance of calibration and per-image correction. The real Sentinel-2 product-change experiment further strengthens the practical relevance.
Critical weaknesses
- Some baseline configurations limit the conclusions drawn from the comparisons. The authors explicitly report that retained thresholds leave SAR, EATA, and TCA nearly inactive in this setting, while some methods use their original ResNet learning rates on Transformer encoders. Although these choices and implementation checks are transparently documented, I still find it difficult to separate limitations of the methods from a mismatch between their configurations and the task. The broader conclusions about existing adaptation methods should therefore be more carefully qualified.
- The method still struggles to combine protection and recovery under class-correlated arrival. When similar classes arrive consecutively alongside mixed degradation conditions or clean images, CALIPER preserves clean-input performance but no longer improves overall accuracy. The authors acknowledge this limitation, but it directly affects the method’s usefulness for continuous observation. In particular, always using the class-conditional correction performs better in these settings, suggesting that the default strategy for combining correction types needs further explanation.
Questions for authors
- Would the main comparative conclusions hold with baseline settings appropriate to the class count and network architecture, without using target labels? I am particularly concerned about the nearly inactive baselines, whose current results may not reflect their recovery capabilities in this setting.
- Why does the default strategy underperform the always-class-conditional variant under class-correlated arrival? Does this arise from insufficient detection of the arrival pattern or from how the two corrections are combined? This distinction would affect my assessment of the method’s reliability on real data streams.