- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DIA-RS², a decoupled information alignment framework for remote sensing image reasoning segmentation. The authors argue that existing Embedding-as-Mask paradigms rely on a single <SEG> token to simultaneously undertake semantic representation, visual evidence grounding, and mask construction, which may lead to semantic-visual misalignment under high visual load scenarios. To address this, the paper designs a VSA module and introduces an independent <CON> token, a CEA, and an EGF module, establishing an explicit alignment pathway from linguistic concepts to visual evidence and ultimately to segmentation prediction.
Critical strengths
- Valuable research motivation. This paper focuses on the potential information alignment bottleneck between high-level semantic understanding and low-level spatial localization in remote sensing reasoning segmentation, particularly emphasizing the localization difficulties in complex scenes and under high visual load conditions. This provides a meaningful perspective for improving the existing Embedding-as-Mask paradigm.
- Complete and reasonable method design. The authors enhance visual feature representation capabilities via VSA, establish the correspondence between concepts and visual evidence using an independent <CON> token coupled with explicit spatial supervision, and inject the retrieved visual evidence into the segmentation prompt via EGF.
- Comprehensive experimental analysis. The authors provide module ablations, spatial attention analyses, evaluations across different visual load levels, cross-category generalization, and few-shot adaptation experiments, as well as a discussion of failure cases in the appendix.
Critical weaknesses
- Insufficient causal validation of the core hypothesis. This paper attributes semantic-visual misalignment under high visual load to the functional coupling within a single <SEG> token, but the current experiments are insufficient to prove that such coupling is the primary cause. Specifically, the G1/G2/G3 structural intervention experiments simultaneously alter spatial supervision, feature interaction, and evidence fusion mechanisms, making it difficult to cleanly attribute the performance gains solely to functional decoupling.
- Lack of direct quantitative evidence for "Spatial Displacement". Although Fig. 2 illustrates changes in spatial responses across different visual load levels and the appendix analyzes the relationship between attention concentration and segmentation performance, these results primarily reflect localization quality and segmentation accuracy rather than directly quantifying the "spatial displacement" phenomenon emphasized by the authors. Furthermore, since CEA itself receives explicit spatial supervision from the ground-truth mask during training, it is not surprising that its attention concentrates more on target regions.
- Relatively limited actual performance contribution from the core DIA module. According to Table 2, on EarthReason, introducing VSA alone improves gIoU from 72.96% to 75.34%, whereas introducing DIA alone only improves it to 73.26%; adding DIA on top of VSA yields a further gain of only 0.73 percentage points. Similar trends suggest that the overall performance gains largely stem from the relatively conventional visual feature enhancement module (VSA) rather than the decoupled information alignment mechanism emphasized in this paper.
- Lack of computational overhead and efficiency analysis. Building upon the LISAt framework, this paper introduces SAM LoRA, multi-level visual feature fusion, additional cross-attention, and evidence fusion modules, yet fails to report parameter counts, FLOPs, inference latency, GPU memory footprint, or training time.
- Insufficient targeted evaluation on high-density, multi-target, and fragmented scenarios. While the motivation emphasizes that remote sensing targets are typically small, densely distributed, and spatially fragmented, the experimental evaluation mainly relies on overall cIoU/gIoU metrics and selected qualitative visualizations, lacking independent quantitative analyses stratified by target density, object count, or fragmentation level.
Questions for authors
Please see weaknesses. I would be willing to raise my score if the authors satisfactorily address the above concerns.