- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
- This paper studies if local object supervision (through a segmentation mask) helps video pre-training methods such as LeVJEPA and VJEPA 2.1. This supervision is instantiated using supervised contrastive loss where patches from object mask represent positives and from non-object mask represent negatives.
- This mask supervision improves action recognition and mask propagation in all four matched LeVJEPA settings, across three encoder sizes.
- The authors experiment with varying the model size and the size of the training data. The object supervision achieves similar/better performance than the baseline with 50% of the data.
Critical strengths
- Using additional mask supervision may help in case of smaller models (which may not have the capacity to learn generalizable features from self-supervision alone) - this is where this idea of weak supervision can be useful.
- The experiments are designed and conducted systematically and thoroughly.
Critical weaknesses
- It is not entirely surprising that object mask supervision during pre-training helps action recognition. LeVJEPA or VJEPA is designed to be self-supervised in the first place -- its strength comes from learning without any supervision. By using mask supervision, it is not clear what the paper is trying to achieve. Yes, it may give a few % benefit on action recognition, but it defeats the purpose of self-supervision.
- For large models, the difference shrinks - indicating that this inductive bias may not be necessary in the first place once again re-inforcing that pure self-supervision scales more favorably than segmentation supervision. It can help with small models though.
- Much of the ideas of this work have been studied in [1] as also stated in the introduction: "Object-centric LeJEPA (Geusen & Konukoglu, 2026) studies image pretraining on still images from COCO." What new challenges/insights does studying the same ideas for video tasks bring?
- (Minor) I think Zhou et al [2] must be referenced since it is quite related.
[1] Object-centric LeJEPA. Jakob Geusen, Ender Konukoglu. ArXiv 2026. [2] How can objects help action recognition? Xingyi Zhou, Anurag Arnab, Chen Sun, Cordelia Schmid. CVPR 2023
Questions for authors
- From the introduction, what does object membership mean? This does not seem like a standard term. "Video JEPA methods learn from videos without action labels (Assran et al., 2025; Kuhn et al., 2026), while object membership remains implicit in their training objectives. We make this information explicit through a local instance-separation loss"