- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces FlashTAM, a memory tokenization approach for running promptable video object segmentation on mobile devices. It uses the predicted segmentation mask to identify and expand a target-centered bounding region, then divides this region into an aspect-ratio-aware grid. Each window contributes the memory feature corresponding to its highest mask-logit location. Integrated into a lightweight SAM 2-based architecture with feature distillation, the approach reduces memory attention costs and demonstrates a competitive balance between segmentation quality and on-device speed.
Critical strengths
The proposed memory selection procedure is simple and computationally inexpensive. It uses mask predictions already available in the pipeline, avoiding a separate selection module. Selecting one representative location per window also encourages broader spatial coverage than unrestricted top-k selection. The component ablations provide evidence that these choices benefit the resulting system.
The evaluation includes multiple VOS benchmarks and measurements on actual mobile hardware. Reporting end-to-end performance provides useful evidence of the method’s practical value.
Critical weaknesses
The methodological contribution is incremental relative to prior approaches to regional processing and memory compression. RMNet (CVPR 2021) restricts memory representations to regions containing the target, while RAVOS (TIP 2024) exploits object ROIs to avoid redundant segmentation and memory operations. EfficientTAM and EdgeTAM already investigate spatially organized memory compression, and Efficient-SAM2 selects salient memory tokens for efficient retrieval. The distinguishing elements of FlashTAM are an expanded bounding box derived from the predicted mask and maximum-logit sampling within local windows. Although reasonable, these choices largely combine established techniques, and the paper offers limited evidence of a broader methodological insight beyond this particular implementation.
The experimental comparisons do not fully isolate the benefits of the proposed memory construction from the surrounding system design. Comparisons with random, top-left, and global top-k sampling help justify the selection heuristic, but leave open how it performs against established compression methods with the same encoder, training procedure, distillation supervision, and memory budget. This is particularly relevant because feature distillation contributes to the final accuracy. Furthermore, constructing memory from predicted foreground regions can exclude useful information when masks underestimate the object or drift toward distractors. The paper acknowledges this vulnerability, but does not adequately characterize its consequences under occlusion, localization errors, or subsequent target reappearance.
Questions for authors
Could the authors evaluate ROI-restricted adaptive average pooling and representative existing memory compression modules using matched training, distillation, and token budgets?
How sensitive is the method to incomplete masks, extended occlusion, and similar-looking distractors? Under a fixed total token budget, would reserving some tokens for global context or background information improve recovery from tracking errors?
Thank you for the detailed response and additional experiments. These results provide useful empirical evidence for the effectiveness of FlashTAM. However, several of my original concerns remain only partially addressed.
W1.The results demonstrate that MRL+WAP outperforms several alternative memory selection strategies. However, improved performance does not necessarily establish methodological novelty. The proposed components still primarily rely on existing ROI localization and window-wise selection operations.
W2.The disappearance and reappearance experiments are useful but do not directly assess robustness to inaccurate mask predictions. Natural disappearance differs from ROI localization errors, which may accumulate over time and cause irreversible tracking failures. Controlled experiments with varying levels of mask corruption would provide more direct evidence of tracking robustness.
W3 and W4 have adequately addressed my concerns. I thank the authors for providing the additional experimental results.
Overall, the additional experiments strengthen the empirical evaluation, and I acknowledge the practical efficiency advantages of FlashTAM. But there are still some concerns remain insufficiently validated and need clarification.