- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how to compress the fetal ultrasound vision-language model FetalCLIP into a smaller model, MobileFetalCLIP. The main idea is to have the student mimic the teacher's image-text similarity judgments in the early stage of training, then deliberately move away from the teacher's predictions for mismatched image-text pairs in the later stage, while continuing to strengthen the alignment of matched pairs.
Critical strengths
- The problem is well defined, and the proposed method is simple. The changes are limited to the training objective, without introducing additional modules at inference time, which makes the approach well suited to model compression.
- The authors clearly distinguish HC18 agreement from actual gestational age error, as well as variation across training seeds from uncertainty due to patient sampling. They also acknowledge that the same gains were not observed with a larger student model.
Critical weaknesses
- The paper is largely incremental, with relatively modest improvements over prior work.
- The Composite Score is heavily influenced by the HC18 proxy metric, so it does not necessarily reflect the model's overall capabilities.
- The visualizations are poorly presented and look rather ad hoc.
- The key experiment supporting the necessity of the negative phase is based on a single run, which is not enough to draw a robust conclusion.
- The authors should consider whether a "DKD-style" baseline can really serve as a substitute for the original DKD method. The current claims about the comparison with related methods seem somewhat too strong.
Questions for authors
see weakness