- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
RIMAR is a training-free framework for open-vocabulary semantic segmentation that unifies feature comparison and spatial refinement using a Riemannian metric derived from multi-layer feature variations. It combines bidirectional affine attention with geometry-aware graph refinement, requiring no segmentation training or additional visual backbone. Experiments across 13 benchmark settings achieve 41.4% mIoU and 70.6% pixel accuracy, outperforming PEARL under a common evaluation protocol.
Critical strengths
RIMAR achieves strong results across 13 panoramic, fisheye, and perspective settings, improving mean mIoU over PEARL by 2.9 points while also achieving lower inference latency under matched conditions.
Critical weaknesses
- The necessity of the more elaborate geometric and alignment designs is not sufficiently established. Although the complete system performs well, several simpler alternatives achieve similar results. In Table 11, bidirectional affine alignment scores 41.394 mIoU, compared with 41.386 for bidirectional orthogonal alignment and 41.328 for self-self attention. In Table 4, adding feature-distance guidance to RGB-only refinement provides no clear additional average gain. The joint simplification in Sec. 4.3 also trails the full system by only 0.444 points. These results leave the practical benefit of the additional designs unclear.
- The pipeline contains many interacting components, but the provenance of its empirical parameter choices is unclear. Beyond geometric attention, RIMAR includes adaptive layer mixing, prototype adaptation, local/context integration, and two-stage refinement. These introduce choices such as the score scale, blend coefficient, heavy-tail scale, posterior resolution, and iteration budgets. Sec. C.4 explicitly states that the original search procedure and development split for several choices cannot be identified. This makes it difficult to assess how the configuration was selected and whether the reported gains remain stable under reasonable parameter changes.
Questions for authors
- Could you clarify exactly what is removed or replaced in the “w/o BAFAT” and “w/ flat metric” variants in Table 13, and how they differ from the self-self substitution in Table 11 and the joint simplification in Sec. 4.3?
- What data and selection criteria were used to choose the empirical parameters listed in Sec. C.4? Could you report a sensitivity study for the score scale, blend coefficient, and heavy-tail scale?