- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes a training-free framework for fine-grained referring expression segmentation. Referential Attribution Reformulation (RAR) decomposes an expression into host-object and target-part descriptions, using host localization to constrain subsequent part localization. Bidirectional Collaborative Rectification (BCR) then refines the part score map through coordinated propagation and suppression, guided by internal text-to-image attention and visual feature affinity.
The framework is evaluated on RefCOCOm using LISA, M²SA, and Qwen3-VL combined with SAM. Additional experiments assess compatibility with object-level RES on RefCOCO, RefCOCO+, and RefCOCOg. The paper also provides component ablations, a comparison with SAMRefiner, parameter sensitivity analyses, qualitative results, and inference cost measurements.
Critical strengths
1. The paper addresses a meaningful problem and reports improvements across multiple base models. Fine-grained part localization remains substantially more difficult than object-level localization. In Table 3, val-Part mIoU improves from 21.3 to 24.4 for LISA-7B, from 24.5 to 27.4 for M²SA, and from 33.4 to 39.8 for Qwen3-VL+SAM. These results suggest practical value in improving existing models without parameter updates and constitute the strongest evidence supporting acceptance.
2. The design is motivated by the task and has preliminary ablation support. Host localization preserves instance-level context, while the part description focuses the subsequent prediction on the intended region. BCR coordinates expansion and suppression rather than applying either indiscriminately. The full framework outperforms either component alone in Table 4, and collaborative rectification improves mIoU from 23.0 to 24.4 in Table 5. These findings provide initial evidence for complementary contributions from the proposed components.
Critical weaknesses
1. The experimental evidence conflicts. Table 4 reports 23.1 for “LISA+BCR,” whereas Table 9 reports 22.1 for the apparently corresponding “Original Expression+BCR” setting. Both are evaluated on RefCOCOm val-Part, but no setting difference is explained. This discrepancy affects the estimated standalone contribution of BCR.
2. Insufficient specification of the algorithm and its integration across segmentation paradigms. Section 5.3 describes Qwen3-VL predicting a box for SAM, but does not explain the source of the score maps used by BCR, where rectification occurs, or how attention and visual representations are spatially aligned.
3. Incomplete ablation design. The experiments lack a “host-constrained image+original expression” control for RAR, as well as separate propagation-only and suppression-only ablations for BCR. Moreover, all core ablations are conducted on LISA-7B, although the largest gains occur with Qwen3-VL+SAM. Therefore, the current evidence does not adequately establish which design choices explain the improvements across paradigms.
Questions for authors
1. Do the 23.1 result in Table 4 and the 22.1 result in Table 9 correspond to the same experimental setting? If not, please specify the differences.
2. Could you provide minimal controls that isolate the source of the gains? In particular, “host-constrained image+original expression” on LISA, and RAR-only, BCR-only, and full-framework results on Qwen3-VL+SAM would help distinguish the effects of spatial restriction from those of referential reformulation and collaborative rectification.
Thank you for the detailed response, which has addressed my methodological concerns. My remaining concern is that the fine-grained experiments mainly rely on relatively older base models and baselines, so it is unclear whether the framework still helps with more recent and stronger models. Are there more recent methods on RefCOCOm that could be included for comparison? If so, could the authors evaluate the framework on top of such a stronger recent model?