- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
OmniEarthSeg addresses instruction-driven remote sensing segmentation by introducing OmniGlobal-1.9M, a dataset of 1.9 million samples covering RGB, multispectral, and SAR imagery, and a unified MLLM framework. It combines variable-channel input encoding, modality-aware modulation, and prompt-guided visual enhancement to improve target localization. Experiments show state-of-the-art performance across six benchmarks and strong zero-shot generalization to unseen datasets.
Critical strengths
- OmniEarthSeg supports RGB, multispectral, and SAR imagery with a single model, accommodating variable-channel inputs and incorporating modality-aware and prompt-guided modeling for segmentation.
- OmniGlobal-1.9M provides a substantial data contribution, with approximately 1.9 million samples from over 800K images. Evaluation on six benchmarks and three unseen datasets, together with extensive ablations and instruction-tuned baselines retrained on the same dataset, provides broad empirical support.
Critical weaknesses
- On multispectral benchmarks, baseline methods only use RGB channels, while OmniEarthSeg uses all available channels. This shows the benefit of the overall method, but it is unclear how much improvement comes from the architecture itself rather than the additional input information.
Questions for authors
- Could you compare the methods using the same input channels? For example, could you give a strong baseline access to all channels or test OmniEarthSeg using only three channels?
- Could you explain how the evaluation subsets in Table 10 were selected and why some samples were excluded?
3 comments
Thank you for your rebuttal.
Thank you for the additional experiments and clarifications. The matched-input results largely address my concerns. I encourage the authors to incorporate these results and the corresponding details into the revised manuscript. I maintain my weak accept recommendation.
Thank you so much for your thoughtful assessment and encouraging feedback. We sincerely appreciate your positive evaluation and continued support!
Response to Q1 & Q2
Q1. Matched-Input Comparisons.
A1: We thank the reviewer for this constructive comment. To address this concern, we conducted two matched-input comparison experiments:
(1) We retrained OmniEarthSeg on OmniGlobal-1.9M using the same three-channel input protocol as the competing methods, retaining only RGB bands for multispectral imagery and replicating single-channel SAR imagery into three channels (see Section 5.2.1 of the main paper). We then evaluated the retrained model on the multispectral and SAR benchmarks reported in Table 2 of the main paper. The results are presented below:
Under the same three-channel input setting, OmniEarthSeg achieves the highest mIoU on both benchmarks and the highest oIoU on OpenEarthMap-SAR, demonstrating that its performance advantage is not solely attributable to access to additional spectral information.
(2) We equipped UniGeoSeg [1] with a multichannel input adapter following EarthMind's [2] pseudo-RGB frame representation, enabling it to process all available spectral bands rather than only RGB channels. We then trained both the adapted UniGeoSeg and OmniEarthSeg on the same OmniGlobal-1.9M dataset and evaluated them on the multispectral and SAR benchmarks reported in Table 2 of the main paper. The results are presented below:
OmniEarthSeg consistently outperforms both EarthMind and UniGeoSeg + Adapter across all evaluation metrics. Together, these experiments demonstrate that OmniEarthSeg maintains its performance advantage under matched-input comparisons, whether restricted to three-channel inputs or compared against models equipped with multichannel processing capabilities. We will incorporate these results and the corresponding analysis into the revised manuscript.
[1] UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenes. CVPR, 2026.
[2] EarthMind: Leveraging Cross-Sensor Data for Advanced Earth Observation Interpretation with a Unified Multimodal LLM. arXiv preprint, 2025.
Q2. Evaluation Subset Filtering Criteria.
A2: We thank the reviewer for raising this question. To ensure the reliability of the evaluation subsets in Table 10, we applied two quality-control criteria:
(1) Mask Annotation Quality: Samples with erroneous or incomplete annotations, including masks that do not fully cover the corresponding target objects, were excluded.
(2) Valid Image Area: For datasets requiring image cropping, samples with a valid-area ratio below 0.8 after cropping were excluded to avoid evaluating images with insufficient valid content.
We have clarified these filtering criteria and the reasons for sample exclusion in Appendix A.3.2 of the revised manuscript.