- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes CompatLift, a lightweight feature upsampling framework for remote-sensing open-vocabulary semantic segmentation. It addresses feature compatibility issues in frozen prediction pipelines by combining image-guided residual updates with a bicubic feature anchor. The method uses high-resolution features from the same frozen encoder for supervision and applies score calibration to compensate for confidence shifts. Experiments on eight remote-sensing benchmarks show that CompatLift improves the average mIoU from 53.4 to 54.2 over the original SegEarth-OV3 baseline.
Critical strengths
The method is lightweight and supported by extensive evaluation. CompatLift requires only 0.111M trainable parameters and no segmentation annotations. Experiments across eight remote-sensing benchmarks demonstrate consistent overall improvements, while the ablation studies provide evidence for the contributions of residual mixing and score calibration.
Critical weaknesses
-
The paper does not sufficiently demonstrate the extent to which the identified problem generalizes beyond the specific architecture considered. Although investigating feature upsampling with frozen predictors is a reasonable setting, it remains unclear whether the observed performance degradation reflects a general compatibility issue between feature upsampling and frozen predictors or primarily arises from representation mismatch at the specific feature interfaces of SegEarth-OV3.
-
The core idea of CompatLift is to use bicubic features as an anchor and incorporate only a fraction of the learned update into this reference representation. More importantly, Table 2 shows that applying the same residual mixing strategy to existing upsampling methods can also substantially recover their performance. For example, the average mIoU of AnyUp increases from 28.2 to 52.5, while that of JAFAR increases from 27.0 to 52.5. These results provide strong support for the paper's feature compatibility hypothesis, but they also raise an important question: does the main contribution of this work lie in a new feature lifting method, or primarily in a generic and conservative feature mixing mechanism? The paper does not yet clearly distinguish the respective contributions of the compatibility phenomenon itself, generic residual mixing, and the learned module in CompatLift.
-
The proposed method achieves an average improvement of 0.8 mIoU over the original SegEarth-OV3 baseline (53.4 to 54.2). More importantly, compared with the bicubic baseline equipped with the same score calibration, the full CompatLift improves performance only from 53.7 to 54.2, corresponding to a gain of 0.5 mIoU. Furthermore, Table 3 shows that these improvements are not consistent across datasets: performance slightly decreases on Potsdam, while no improvement is observed on Vaihingen or UDD5. The paper does not report results from multiple random seeds, standard deviations, or confidence intervals. Since CompatLift itself requires optimization-based training, reporting only a single run is insufficient to determine whether such modest improvements consistently exceed the variability introduced by training randomness.
-
There is an inconsistency in the way conference names are written in the references.
Questions for authors
-
What evidence supports the generalizability of the identified feature compatibility problem beyond the specific SegEarth-OV3 architecture?
-
Given that CompatLift improves average mIoU by only 0.5 points over the calibrated bicubic baseline, can the authors provide results from multiple random seeds or other evidence demonstrating that this improvement is robust to training randomness?