- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HSL-ERG for generating examination-level reports from multiple ENT endoscopic images containing partial and complementary evidence. Its two main components are HSRM, which combines frozen CLIP image representations with local visual features and performs hierarchical weighting within and across frames, and RCAL, a bidirectional contrastive loss that downweights potential false negatives based on examination-level visual similarity. Validation covers multi-view ENT-Endo, multi-slice CTRG-Brain, and single-image OCASD, using language-generation and clinical consistency metrics. On ENT-Endo, the method reports improvements of 0.010 in BLEU-4 and 0.020 in clinical F1 over the strongest reported baselines for each metric. Additional experiments include component ablations, input-view and loss-weight sensitivity analyses, report-pairing perturbations, and qualitative examples.
Critical strengths
1: The paper addresses a meaningful examination-level report generation problem. ENT examinations contain multiple local views with partial and complementary evidence, while supervision is provided through a single report. The dataset analysis grounds this challenge in a concrete clinical setting, making the problem formulation a substantive motivation for studying multi-view aggregation.
2: The main benchmark provides encouraging evidence of practical utility. On ENT-Endo, the method improves BLEU-4 from 0.224 to 0.234 and clinical F1 from 0.518 to 0.538 over the strongest reported results for each metric. Component ablations also show gains from both HSRM and RCAL individually. These findings support the usefulness of the combined approach.
Critical weaknesses
1: The central claim of diagnostic semantic enhancement is insufficiently substantiated. The HSRM ablation jointly changes CLIP feature fusion, local weighting, and frame weighting, leaving unclear whether gains arise from the proposed aggregation mechanism or simply from additional pretrained features. Figure 7 shows CLIP similarities rather than learned frame weights, without independently validating their diagnostic relevance. Consequently, the evidence does not establish that HSRM identifies and prioritizes complementary diagnostic views, which is central to the claimed contribution.
2: The contribution of the frozen CLIP semantic prior is not established. The paper motivates CLIP features as high-level semantic context for medical images, but the HSRM ablation jointly changes CLIP feature fusion and attention-based aggregation. It therefore does not establish whether CLIP contributes useful diagnostic information or whether the gains arise from other components. This matters because semantic enhancement is central to the paper’s explanation of its contribution.
Questions for authors
Clarification on CLIP semantics: Is the frozen CLIP representation used in HSRM the CLS token before CLIP’s output projection or the final projected image embedding? What evidence, including visualizations or analyses of anatomical structures or pathological findings, supports its interpretation as a diagnostic semantic prior for ENT endoscopic images?
Clarification on frame importance: Are the CLIP similarities in Figure 7 used to compute the learned frame weights, or are they shown only for illustration? What evidence links the actual aggregation weights to independently identified diagnostic frames and their corresponding generated findings? This would help establish whether HSRM prioritizes clinically important evidence.