- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CoSlot, a parallel video object-centric learning framework that maintains object identity without sequential slot propagation or explicit matching. CoSlot first performs joint slot attention over all video patches to obtain clip-level object representations, followed by independent per-frame refinement using shared slot-attention weights. The framework employs a clip-level agreement loss with reference masks from pretrained segmentation models and achieves competitive performance against existing methods. The paper further provides a theoretical analysis explaining temporal identity consistency through a shared partition of the projected feature space.
Critical strengths
-
The proposed framework eliminates sequential slot propagation and explicit matching while achieving competitive performance with existing video object-centric learning methods. This demonstrates the feasibility of an alternative approach to temporal identity preservation.
-
The paper provides a geometric interpretation of slot assignments through convex partitions of the feature space, offering useful insights into how temporal consistency can emerge without explicit propagation.
Critical weaknesses
Heavy reliance on external supervision and limited justification of the learning paradigm.
- The proposed method relies on reference masks generated by existing models, including SAM 3 for real-world videos. This makes the contribution appear closer to an application of foundation-model supervision than a fundamental advance in self-supervised video object-centric learning.
- Given the availability of such powerful segmentation models, it is unclear whether the proposed slot-based learning framework is necessary. Simpler alternatives, such as constructing object representations by pooling DINOv2 features within regions identified by a foundation segmenter, should be investigated.
- Furthermore, if the primary advantage of this approach is its 'applicability' to downstream tasks, its practical value would be more convincing with evaluations on tasks such as world modeling or future dynamics prediction, rather than segmentation metrics alone.
Insufficient motivation and experimental evidence for replacing sequential slot propagation.
- The motivation for eliminating sequential propagation is not sufficiently justified. Existing methods explicitly propagate slot representations across frames to preserve temporal correspondence, which is beneficial for maintaining object identity. The paper does not clearly establish why this mechanism is problematic or should be replaced, beyond the advantage of parallel computation. Moreover, the computational benefits are not quantitatively evaluated.
- The proposed framework incorporates several existing components from SlotCurri, including the slot-count curriculum and SSIM-based reconstruction objective, while also introducing additional supervision. Despite these components, the improvements over SlotCurri are relatively modest on the synthetic benchmarks.
- More importantly, the ablation study lacks a controlled comparison in which only SlotCurri's sequential slot encoding is replaced with the proposed parallel encoding, while keeping the remaining training objectives and components identical. Therefore, it is difficult to determine whether the improvements arise from the parallel architecture itself or from the additional supervision and training mechanisms.
Questions for authors
- Could the authors provide an experiment that replaces only the sequential slot encoding in SlotCurri with the proposed parallel binding architecture, while keeping the other components and training objectives unchanged? Such a comparison would help isolate the contribution of the proposed architecture from that of the additional losses and supervision.
- Given that SAM 3 provides object-level reference masks, how does the proposed learning framework compare with simpler alternatives, such as pooling DINOv2 features within segmented object regions to construct object representations? In particular, what additional benefits does the proposed two-stage slot-attention architecture provide over such approaches?
- In Figure 2 (right), the performance improvement over SlotCurri appears particularly large for shorter clips, while the gap is smaller in several longer-clip groups. What explains this observation? Could it indicate that sequential slot propagation becomes more beneficial as the clip length increases? A more controlled analysis across different clip lengths would help clarify the relative advantages of sequential and parallel binding.
- Does the learned object-centric representation provide advantages for downstream tasks such as future frame prediction, object dynamics prediction, or world modeling? Such experiments would help establish the practical significance of the proposed learning framework, particularly given its reliance on foundation-model-generated supervision.