- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
Paper tackles text-guided image segmentation problem and propose RCEA-MoE. RCEA-MoE, use negative clinical description into disease, location and extend factor along with the positive description. Paper introduce Reliability-Gated Contrastive Expert Attention (RCEA) and use contrast between positive and negative text features and uses spatial gates to control feature updates. An image and positive-text router combines the experts (disease, spatial and extent) and an EMA teacher provides pseudo-label.
Critical strengths
Paper addresses a relevant problem of limited availability of annotated data and propose a solution to improve the task (segmentation) using additional textual description (negative clinical description).
Critical weaknesses
- I think paper would require a comprehensive evaluation and ablation to justify the claims. There many components introduced, motivation and impact needs to be validated in the results section.
- There are many issues with the presentation. Method section is convoluted and does not clearly give the overall Visual tokens are defined as U in figure 2 and used as V in the text, PE is defined in the caption but not present in the figure 2. There is notional overloading at places. Section 3 will require major rewritten to improve the readability.
Minor comment:
- There is no code in the anonymous link shared in the paper. Paper does not provide enough information for reproducibility. Literatures reported results for the baseline, were they trained in the same manner as the proposed method?
Questions for authors
- The paper does not provide the contribution of each clinical description to improve the final segmentation (numerical grounding will help). How did you decide to provide the additional text as a negative clinical information rather than addition the same information as part of the positive text? Is there an understanding regarding what will happen in this context?
- What is the single expert visual baseline? Is it ConvNeXt-Tiny with only positive clinical description? Also in the ablation, one should change one component at a time to clearly state the contribution of that component.
- Is there any reason for choosing ConvNext-tiny? How will the results change if we use some other model for visual feature extractor?
- Which language model did you use to generated the negative descriptions? Did you or any clinician checked the LLM generated negative clinical descriptions? What will happen in the case if any of the descriptions is misleading? How do you filter that?
- How does this method be applied to other general tasks? How do you decide upon the clinical descriptors?
- There are many losses used in the paper, how do you decide upon the weighting factor of each one of them? Can you provide the additional overhead in-terms of parameters and inference time? Is there an understanding by keeping the batch-average routing weights uniform will help?
- Numbers of TeViD does not match with the paper, on QaTa-COVID19 they provide 86.37 and authors have quoted 88.23. Did you reimplemented the baseline? Implementation details regarding the baselines should be provided in the paper.