- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces MRR-COS, a task for segmenting camouflaged targets using referring text, reasoning text, reference images, or reference sounds, and constructs MR2C with 9932 images covering 64 categories. Its MCOSA baseline combines multimodal token representations, segmentation-token refocusing, and query-conditioned local matching at multiple scales before mask decoding. Evaluation includes benchmark comparisons, component and training-data ablations, related segmentation tasks, reference perturbations, and an explanation-quality study involving 20 examples and five annotators.
Critical strengths
- MR2C provides a common camouflage evaluation setting for four reference types, with 19,864 textual references, 1,920 reference images, and 640 sounds, supported by manual checking procedures. MR2C’s useful contribution is bringing these reference forms together for segmentation in static camouflaged scenes.
- SUM offers a concrete architecture by normalizing a segmentation query’s attention over spatial positions within each local patch. With the backbone, decoder, and training schedule held constant, Table 12 reports multi-object mIoU of 59.4 for SUM versus 56.8 for MS-Fusion and 57.0 for MS-Attention, providing preliminary evidence for this matching design.
Critical weaknesses
- MCOSA’s refocusing equations use the same attention-weighted residual form and coefficient already introduced by AnyRef. A possible extension from generated output tokens to all preceding tokens is neither clearly distinguished nor separately evaluated. Consequently, the manuscript does not establish a new refocusing mechanism, leaving SUM as its main identifiable architectural addition.
- The correspondence between category-level references and target masks is underdefined for multi-object scenes. Section 3 retains masks for the selected target while removing other annotated regions, but image and sound references are collected by category, and the supplied appendices do not explain how the selected mask is determined when several instances match that category. Figure 6’s plural bat references make this distinction relevant, because selecting one instance and segmenting all matching instances require different ground truth and imply different assessments of user intent.
Questions for authors
- What aggregation formula and evaluation sample counts reproduce the All, Single, and Multi scores in Table 3 from the test partition reported in Table 2?
- Does Eq. 5 aggregate only generated output tokens or also input tokens, and what substantive difference from AnyRef’s Eq. 2 is intended?
- When a reference image or sound matches several instances of the same category, does the ground-truth mask include all of them, and how is a subset specified when only some are selected?
- What training-data mixtures, sampling proportions, and numbers of updates were used for the adapted baselines in Table 3, particularly AnyRef and OISA, relative to MCOSA?