- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses weakly supervised semantic segmentation by introducing a text-modulated cross-layer xConvLSTM framework to mitigate incomplete object coverage and spurious background responses during multi-layer CLIP feature integration. The proposed approach formulates cross-layer aggregation as concept-conditioned memory updates along network depth, where text embeddings control how spatial memory incorporates, retains, and suppresses visual evidence. Furthermore, anchored adaptive prompting is introduced to adapt text representations to individual images via bounded learnable and image-conditioned residuals while anchoring pre-trained CLIP semantic priors. Extensive experiments on PASCAL VOC 2012 and MS COCO 2014 demonstrate the effectiveness of the proposed model.
Critical strengths
- This paper proposes a text-guided adaptive fusion mechanism that enables the complementarity between shallow and deep CLIP features, effectively improving the methods for using CLIP features in the experiments of the weakly supervised segmentation field.
- The ablation study validates the contribution of each component separately, providing support for the effectiveness of the proposed design.
Critical weaknesses
- The abstract and introduction of the paper emphasize "consistent segmentation gains", but Table 1 only shows a 0.4 mIoU improvement on VOC compared with WeCLIP+, and the scores on COCO are identical. This gap can hardly be regarded as a real gain, which contradicts the claim of "consistent improvement".
- The whole paper focuses heavily on "text modulation", with the title and contributions all centered around it. However, in Table 2, removing xConvLSTM leads to a 0.9 mIoU drop, while removing text modulation only causes a 0.2 drop — it is the cross-layer memory itself that actually plays the major role, and the marginal effect of text modulation is actually the smallest.
Questions for authors
- The abstract and introduction of the paper emphasize "consistent segmentation gains", but Table 1 only shows a 0.4 mIoU improvement on VOC compared with WeCLIP+, and the scores on COCO are identical. This gap can hardly be regarded as a real gain, which contradicts the claim of "consistent improvement".
- The whole paper focuses heavily on "text modulation", with the title and contributions all centered around it. However, in Table 2, removing xConvLSTM leads to a 0.9 mIoU drop, while removing text modulation only causes a 0.2 drop — it is the cross-layer memory itself that actually plays the major role, and the marginal effect of text modulation is actually the smallest.
- There are no comparisons of parameters, FLOPs, training time, and inference cost in the main table at all. One of the contributions of WeCLIP+ is its low training cost. After adding new modules on the basis of it, this paper does not explain how the cost changes.
- The method overview states that the selected layers are L = {2,5,8,10}, while in the experimental part it is described as "the 3rd, 6th, 9th, and 11th CLIP visual blocks". The two parts are inconsistent. Besides, why 4 layers? Why these specific layers?