- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
Brief Summary: The paper tackles the task of Referring Video Object Segementation; here the model is provided with a video sequence + a natural language query and the model is required to provide bounding box / instance segmentation mask for the referred objects in the video. This doesn't require temporal grounding, so no timestamps for the objects (aka not spatio-temporal).
The main idea is to use Qwen3-VL with query-vectors (interaction/actor/target), and interaction query are used with video features to have auxillary mask loss; separately the three query-vectors are combined to get text-outputs which are then passed to SAM3 to get the final segmentation output.
Experiments on InterRVOS-127K show significant improvement over previous baselines.
Critical strengths
Pros:
-
Paper studies an important problem in referring expression.
-
Authors show cross-dataset generalization (appendix A). Qualitative Visualizations are good.
Critical weaknesses
Cons:
-
The main idea is incremental, it uses specific query vectors for interaction/actor/target but this is not generalizable outside of this specific use-case, and even here seems to be working on a specific dataset not other datasets (see point4).
-
The baselines are not strong. Obvious baselines like simply prompting Qwen3-VL to give points/bboxes and the passed to SAM3, or even directly giving the prompt to SAM3.
-
Only Qwen3-VL baseline is used, authors should also try InternVL for fair comparison with ReVIOSa. Given the backbone change it is unclear where the gains are coming from.
-
It seems like it doesn't generalize to other datasets? Such as being worse than VIRST on Ref-DAVIS and Ref-Youtube-VOS? Authors haven't expanded on this observation either.
-
(Minor) It is tough to understand why we need dice loss just for auxillary use case when the final segmentation is via SAM3 directly?
Questions for authors
see weakness