- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper distills CLIP ViT image modual into a 724K-parameter MobileNetV2-0.35× student using Matryoshka contrastive and logit distillation on CC3M. The results show that a capacity–granularity boundary about 93 vs 277 effective dimensions, a dominant teacher coordinate (133) that distorts per-image COCO accuracy at 256-d, teacher-specific alignment while other encoders' prototypes score at chance, partly recoverable by a closed-form map, and INT8 deployment on an ESP32-S3 (measured) and STM32H7.
Critical strengths
This work is practival impelementation oriented, and has real hardware measurements and good reproducibility details. The experiment results are explained clearly and easy to follow. The method is problem-based and engineering-based.
Critical weaknesses
It seems the causal claims are weakly supported by the experiment results because capacity and pretraining coverage are not separated with one student size and one data scale setting. Also the deployed 128 px INT8 pipeline reaches 16.0% per-image COCO accuracy, below the 31.6% majority class, and main results use a 224 px FP32 student that cannot run on the MCU. The STM32H7 is only emulated and no latency is reported, and the 128 px loss was not mitigated by training at that resolution.
Questions for authors
I would like to aks how does the conclusion about coordinate 133 / mean-direction removal change with multiple seeds and a metric that is not majority-dominated?
I thank the authors for the clarifications, which resolve my question on the on-board measurements. However, the overlap analysis confirms that the prototype-portability result reflects concepts that are lexically held out but semantically present, and the semantically disjoint split needed to support a transfer claim has not been reported. Since the authors also agree that the contribution is limited to a small-vocabulary, coarse-category operating point, I maintain my original score.