- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper adapts a frozen I-JEPA vision encoder with lightweight prediction heads for grasp detection. The main claim is that frozen representations generalize better than end-to-end trained models. While the empirical setup has some carefully designed controls, several problems with method novelty, experimental fairness.
Critical strengths
-
This paper explores the feasibility of using the frozen large-scale pre-trained model (I-JEPA) for object detection and demonstrates its good robustness in out-of-distribution scenarios.Useful for real-world deployment.
-
The experimental setup was comprehensive.
Critical weaknesses
-
This paper merely added a lightweight double-tower structure on the basis of the I-JEPA framework, without adapting the features for the grasping tasks. The innovation of the method is insufficient.
-
The experimental comparison is unfair. The abstract and introduction state that frozen representation is better than end-to-end training, but the main text does not conduct the same architecture I-JEPA end-to-end fine-tuning experiment. Additionally, the 632M ViT-H is compared with a small CNN of only a few M, and the parameter quantity difference is more than an order of magnitude. This merely indicates that large models have a large number of parameters, but it cannot prove that frozen representation is necessarily better than end-to-end training.
-
The empirical evidence for generalization ability is scarce. Most test objects have already appeared from other perspectives in the training set, so the generalization ability for unseen objects has not been fully verified. Moreover, the experiments were conducted only on the Cornell single dataset, lacking cross-dataset validation, and no real robot closed-loop tests were carried out.
-
Appendix A and B are contradictory. A.4 states that without performance enhancement, it drops to 61.8%; enhancement is necessary. B.3 re-ran the same experiment, with or without enhancement, it remained around 85%, which fails to demonstrate the necessity of enhancement.
-
The relevant work has not been written in a comprehensive manner.
Questions for authors
See the Weaknesses.
Thank you for the review. We respond to each weakness below.
Regarding method novelty. We agree that our contribution is empirical: the head is deliberately lightweight, and we do not adapt the I-JEPA features to the grasping task. The next version will present the work as a controlled study of frozen representations rather than as a new method.
Regarding tairness of the comparison. We would like to clarify one point. Section 5.4 includes a control with the same ViT-H/14 architecture, the same 632M parameters, and the same head as NDB-JEPA, but with random frozen weights. This control reaches only 60.7% on clean images against 86.9% for I-JEPA, and it fails completely under darkening (0.0%) according to our experiments. We have made this code available to test out as well. In Table 1, DINOv2 ViT-g/14 is the largest encoder at approximately 1.1B parameters, yet it remains below both I-JEPA and the supervised ViT-H/14. We believe that model size alone does not explain our results, but would like to do more experimentation to have an even stronger argument for this. However, you are right that we do not fine-tune I-JEPA end-to-end, because this was infeasible on our available compute, and Section 5.4 states that our controls do not separate freezing from fine-tuning. As Section 5.3 notes, NDB-JEPA and GR-ConvNet also differ in architecture, capacity, and training regime, so that comparison does not isolate the effect of freezing a pretrained encoder. Our abstract and introduction should not suggest that frozen representations are better than end-to-end training in general, and we will revise both to claim only what the controls support.
Regarding the generalization evidence. Our evidence for generalization is limited: most test objects appear in the training set from other viewpoints, as we state in Section 4.2, so our results do not establish generalization to unseen objects. We will add an object-wise split and a controlled cross-dataset evaluation. We will also revise our wordings to better match the results of these additional tests.
The contradiction in our appendices is valid. The A.4 ablation applied augmentation once, when the dataset was constructed, to every split. Appendix B.3 repeats the ablation on the validation split with three seeds and with augmentation applied to the training split only, and there augmentation has no measurable effect. B.3 says that the earlier result does not reproduce, but we left A.4's statement that augmentation is vital in place, which was a mistake; the next version will report only the B.3 result. None of the backbone, low-shot, or corruption experiments use data augmentation, so our main results are not affected. This wording was an artifact of our iteratively working through the experiments and we should have been diligent to clean up any obsolete findings.
Regarding our related work. Our related work is not comprehensive, in particular for grasp detection; the next version will cover recent foundation model grasp detectors and robot control methods.