- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a sparse-to-dense annotation framework for event motion segmentation through bidirectional enhancement between motion estimation and mask generation. The Motion-to-Mask module generates motion-compensated event representations for SAM2-based segmentation, while the Mask-to-Motion module employs mask-aware contrastive learning to refine trajectory estimation. The framework aims to generate dense masks and event-wise annotations from sparse bounding-box prompts without requiring pixel-level mask or optical-flow supervision.
Critical strengths
Practical motivation and application value.
The paper addresses the labor-intensive annotation problem in event motion segmentation. Generating dense annotations from sparse user interactions is a meaningful research direction with practical applications.
Reasonable integration of motion and segmentation.
The proposed bidirectional framework provides an intuitive connection between motion estimation and segmentation. Using motion-compensated representations to improve segmentation and segmentation information to guide motion learning is conceptually appealing.
Comprehensive experimental evaluation.
The paper evaluates the framework across multiple datasets and provides ablation studies, event-wise annotation experiments, and user studies. These results offer empirical support for the overall approach.
Critical weaknesses
Potential error propagation in bidirectional enhancement.
The proposed framework relies on SAM2-generated masks to refine motion estimation, while the quality of these masks depends on the estimated trajectories. This mutual dependency may reinforce incorrect predictions, particularly when the initial motion estimates or segmentation results are unreliable. The paper does not sufficiently establish the robustness of this feedback mechanism.
Questionable assumptions in mask-aware contrastive learning.
The proposed contrastive objective encourages features within the same segmentation region to be similar. However, spatially coherent regions do not necessarily exhibit consistent motion, especially for non-rigid objects or complex motion patterns. The suitability of this region-based supervision for general motion estimation requires stronger justification.
Unclear reliability of automatically generated annotations.
The framework aims to produce dense annotations from sparse human input, but its effectiveness depends on the quality of the estimated trajectories and propagated masks. The paper provides limited discussion of how annotation errors can be detected or corrected when generating pseudo-labels without dense supervision, raising concerns about reliability in practical annotation workflows.
Questions for authors
- How does the proposed bidirectional enhancement prevent errors in motion estimation and segmentation from reinforcing each other? Is there any mechanism to identify or suppress unreliable pseudo-masks during training?
- What justifies treating features within the same segmentation region as positive pairs for motion representation learning? How does this assumption hold for non-rigid objects or regions containing diverse motion patterns?
- How does the framework ensure the reliability of automatically generated dense annotations when no ground-truth masks are available? What happens when incorrect masks are propagated across time?