- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposed ReVEAL for reasoning video object segmentation (ReVOS). During video reasoning by a multimodal large language model (MLLM), ReVEAL introduces three types of visual evidence tokens (VET) : <OBJ> marks the target to be segmented, <BG> marks background regions to suppress, and <NEG> marks foreground distractors that may be confused with the target. ReVEAL extracts role-specific evidence from the attention of these tokens to video visual tokens and uses a Dynamic Attention Layer Router (DALR) to select and weight attention maps from different Transformer layers. It then fuses target and suppressive evidence, samples point prompts from the fused map, and feeds them to a frozen SAM2 model for segmentation.For training, the authors construct ReVEAL-47K, a dataset containing approximately 47K role-annotated reasoning traces, and introduce a Contrastive Attention Grounding Loss (CAGL). CAGL encourages role-specific attention maps to align with their corresponding regions or avoid designated regions. The authors evaluate ReVEAL on several ReVOS benchmarks and conduct ablations of multiple components and inference strategies. Overall, the results provide empirical support for the effectiveness of ReVEAL.
Critical strengths
-
The role-aware evidence modeling is clearly designed. The paper introduces three role tokens for ReVOS—
<OBJ>,<NEG>, and<BG>—to represent the target, foreground distractors, and background regions, respectively. This allows the model to express the roles of different visual entities during reasoning. At inference time, DALR dynamically selects and weights attention maps from multiple layers based on the input to produce role-specific visual evidence. During training, CAGL applies region-level constraints to these role-specific attention maps, encouraging more discriminative visual grounding. -
The dataset construction and experimental evaluation are reasonably extensive. The authors use capable multimodal models, including Gemini 2.5 Pro and Qwen3-VL, to construct and filter ReVEAL-47K, a dataset of approximately 47K role-annotated reasoning traces. This provides a data foundation for training models to produce role-aware visual evidence. The paper compares ReVEAL with different types of methods across multiple benchmarks and includes ablations of key components and inference settings, providing broad empirical support for the method. The appendix also reports detailed training hyperparameters and inference settings, which aids understanding and reproducibility.
Critical weaknesses
-
The quality of the synthetic data ReVEAL-47K. The role-annotated reasoning traces in ReVEAL-47K are primarily generated by one model and filtered by another. The paper does not report manual auditing, annotation error rates, or quality analyses across data sources. Consequently, it is difficult to assess how much the reported gains depend on the reliability of the synthetic annotations. The authors should manually audit a representative sample and report the accuracy of VET placement and target/distractor identification, or provide another quantitative quality assessment.
-
Multiple
<NEG>cases. CAGL-R does not explicitly enforce instance-level separation among multiple<NEG>tokens. For each<NEG>, CAGL-R defines the union of the target and background regions as the forbidden region. However, it neither encourages the attention maps of different<NEG>tokens to be distinct nor provides instance-level positive region supervision for each token. As a result, multiple<NEG>tokens could attend to the same distractor or produce highly overlapping attention maps. Figure 12 provides qualitative examples in which distractors are distinguished, but does not establish that this behavior is reliable across samples with multiple distractors. The authors should report quantitative separation metrics for multiple<NEG>cases or analyze how this issue affects final segmentation performance.
Questions for authors
Please refer to weaknesses.
3 comments
Response to authors
Thank you for the detailed response. The additional analyses and experiments provide further evidence supporting the effectiveness of the proposed method. I recommend incorporating these results into the revised manuscript.
I will maintain my original rating of Weak acceptance.
Reply to reviewer
Dear Reviewer,
Thank you again for your positive assessment of our work and your valuable suggestions, which have helped us further improve the quality and clarity of our paper. We have incorporated the revisions discussed during the rebuttal into the manuscript and uploaded an updated version of the paper.
Best regards,
The Authors of ReVEAL
Reply to Reviewer CKEd
We thank the reviewer for highlighting our well-designed role-aware modeling and extensive experimental evaluation. We address the specific concerns below.
W1. ReVEAL-47K quality analysis
Annotation reliability. We manually checked 130 CoT traces sampled from Ref-DAVIS, Ref-YouTube-VOS, and MeViS v2, three sources with relatively high rejection rates during automatic CoT data filtering, to assess target/distractor identification and VET placement.
<OBJ>identification<NEG>(single distractor)<NEG>(multiple distractors)Additionally, 94.4% (236/250) of inspected VETs have correct insertion positions and role annotations, further supporting the reliability of ReVEAL-47K's reasoning traces and annotations.
W2. Multiple
<NEG>tokens and segmentation performanceScope of distractor grounding. Reasoning video object segmentation aims to identify and segment the queried target. Accordingly, ReVEAL leverages
<NEG>tokens to provide auxiliary suppressive evidence for target discrimination, rather than treating distractor segmentation as a separate objective. Enforcing precise instance-level grounding for each<NEG>would extend the task to joint multi-instance segmentation, potentially introducing additional supervision, annotation costs, and training complexity.Context-guided instance grounding. Although without explicit instance-level supervision, different
<NEG>tokens can still attend to their corresponding distractors to some extent through CoT semantics. Appendix Fig. 12 shows two<NEG>tokens attending to girls on either side of the target, while Fig. 13 shows separate responses to a cow and a man in a light-blue shirt.Impact of multiple
<NEG>tokens on segmentation performance. We conducted a paired ablation on evaluation samples containing at least two generated<NEG>tokens, comparing the use of only the first<NEG>attention map against the fusion of all<NEG>attention maps.The results show that incorporating all
<NEG>attention maps consistently improves the final SAM2 J&F. This indicates that additional distractor cues can effectively improve target segmentation, even when the attention maps of different<NEG>tokens may overlap. Overall, we focus on how suppressive evidence improves target segmentation, leaving finer-grained instance grounding or visually similar scenes for future work.We hope our responses can address your concerns. We will carefully incorporate all suggested improvements into the revised manuscript and sincerely welcome any additional feedback.