- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes OneSEG, a framework for GRES. Instead of generating multiple [SEG] tokens for individual instances, OneSEG uses a single [SEG] token to capture the shared referential semantics and performs instance prediction in the downstream decoder. Specifically, the SIQD module transforms the shared semantic representation into instance-aware queries using visual features. These queries are then decoded into segmentation masks. An IEV further evaluates each candidate mask using region-level visual evidence to filter invalid predictions.
Critical strengths
1.Clear motivation and effective framework design.
2.Strong experimental results.
3.Well-designed figures.
Critical weaknesses
None
Questions for authors
1.In Table 8, the authors compare OneSEG with single-[SEG] and multi-[SEG] baselines. However, OneSEG also introduces additional components, including SIQD, IEV, and a refined mask decoder. Therefore, it is difficult to determine how much of the improvement comes from the proposed single-[SEG] decomposition strategy rather than the additional modules. Could the authors provide a more controlled comparison using the same backbone, decoder, verifier, and training settings? This would help clarify the effectiveness of the core design.
2.OneSEG achieves substantial improvements in N-acc on gRefCOCO, which may also contribute significantly to its gIoU gains, given the large proportion of no-target samples. Could the authors report segmentation performance separately on target-present samples? Additionally, since the proposed method uses a fixed number of six instance queries, it would be helpful to provide instance-level evaluation across different target cardinalities, especially when the number of targets exceeds six. These results would better demonstrate the claimed multi-instance prediction capability.
2 comments
Response to Question 2
Response to Q2:
We agree that the improvement in N-acc contributes to the overall gIoU gain. Figures 7 and 8 already provide the sample counts and cardinality-specific segmentation results on gRefCOCO val and MUSE test, allowing target-present performance to be examined separately from no-target recognition. Figure 7 reports the number of samples in each target-cardinality group, and Figure 8 reports the corresponding gIoU and cIoU. Aggregating the nonzero-cardinality groups by their sample counts, OneSEG achieves 78.5 gIoU on target-present samples in gRefCOCO val.
The improvement in no-target recognition is also an intended outcome of our design. GRES requires both identifying the correct regions when valid referents exist and returning an empty prediction when they do not. OneSEG separates shared semantic understanding from downstream instance prediction, allowing target-existence decisions to incorporate spatial evidence from decoded candidates. In particular, IEV evaluates each candidate using its mask-conditioned visual features, global context, and instance representation. This enables the model to suppress candidates whose predicted regions do not support the referring expression.
Our objective is therefore to improve target identification and existence prediction through semantic-instance decoupling, rather than primarily to improve mask boundary quality. The gains in N-acc reflect this objective, while the target-present results separately characterize segmentation performance when valid targets exist. Reporting both provides a clearer view of the model’s behavior across the two types of GRES samples.
Regarding the fixed query count, Figure 8 includes results for samples with more than six targets. Despite using six instance queries, OneSEG maintains competitive gIoU and cIoU in this group. Notably, on MUSE test, both metrics for the more-than-six-target group exceed the corresponding averages over the full test set. Thus, the reported segmentation performance remains competitive beyond the default query count, as measured by the benchmark’s gIoU and cIoU metrics. The sample counts in Figure 7 are useful for interpreting these results. High-cardinality samples are relatively scarce in gRefCOCO val, whereas MUSE test contains substantially more multi-target examples. The MUSE results therefore complement the gRefCOCO analysis by evaluating performance on a dataset with more extensive coverage of multi-target cases.
For easier reference, we provide the numerical results from Figure 8 in tabular form below.
On gRefCOCO val:
| Number of targets | Sample count | gIoU (%) |
|---|---|---|
| 0 | 6,966 | 88.5 |
| 1 | 3,999 | 73.4 |
| 2 | 5,297 | 80.8 |
| 3 | 467 | 71.5 |
| 4 | 96 | 60.5 |
| 5 | 28 | 48.9 |
| 6 | 5 | 61.8 |
| >6 | 12 | 53.5 |
| Target-present | 9,904 | 77.0 |
| On MUSE test: | ||
| Number of targets | Sample count | gIoU (%) |
| --- | ---: | ---: |
| 0 | 0 | N/A |
| 1 | 307 | 62.4 |
| 2 | 727 | 69.9 |
| 3 | 163 | 63.3 |
| 4 | 2,276 | 66.9 |
| 5 | 674 | 66.7 |
| 6 | 157 | 67.9 |
| >6 | 48 | 72.4 |
| Target-present | 4,352 | 67.0 |
Response to Question 1
Response to Q1:
Thank you for the suggestion. We have updated Table 8 to isolate the contribution of the single-[SEG] decomposition strategy from the additional components. The controlled baselines use the same Qwen3-VL-4B backbone, basic mask decoder, and training settings. IEV, VSF, and the refinement decoder are excluded from all baseline variants, so the comparison focuses on how instance representations are formed.
Under these matched conditions, the OneSEG baseline achieves 78.6 gIoU, improving over the single-[SEG], multi-[SEG], and query-based baselines by 5.4, 1.9, and 3.3 points, respectively. It also achieves the highest cIoU and N-acc among the baseline variants. These gains are obtained without the additional fusion, verification, or refinement components.
The comparison with the single-[SEG] baseline examines the benefit of converting shared referential semantics into separate instance hypotheses instead of directly predicting one global mask. The multi-[SEG] and query-based baselines provide complementary comparisons: both maintain multiple instance representations, but form them through autoregressive token generation or queries within the MLLM. OneSEG instead forms these representations downstream, conditioned on the shared [SEG] representation and visual evidence. Its stronger performance under matched settings supports this decomposition strategy.