- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CLAIR-Med proposes a neural symbol medical image classification framework that eliminates the need for manual concept annotation, aiming to alleviate the trade-off between the interpretability of explicit symbolic reasoning and the predictive performance of neural predictors. The paper conducts experiments on five medical image datasets and the CUB dataset, experimental results show that the framework achieves high symbol prediction coverage while maintaining near-neural predictor accuracy. However, existing results still lack sufficient validation regarding the independent contribution of the key routing mechanism and the clinical reliability of the learned concepts.
Critical strengths
1.The research question has clear relevance and practical significance. This paper focuses on whether explicit symbolic reasoning can truly participate in final decision-making, shifting the research focus from the traditional trade-off between prediction accuracy and interpretability to selective symbolic prediction with clear decision-making significance, particularly applicable to applications such as medical imaging that emphasize decision interpretability. 2.Experiments cover multiple dimensions and provide preliminary evidence supporting the framework's effectiveness. The authors validated the method on six datasets and conducted analyses from the perspectives of symbolic branching accuracy, knowledge distillation, dynamic routing, rule replay consistency, and concept intervention. Furthermore, concept deletion experiments and medical expert evaluations provide some evidence for the potential effectiveness of concept representation. These results demonstrate that the proposed framework has practical potential, rather than merely remaining at the conceptual system design level.
Critical weaknesses
1.The independent contributions of the core technological innovations are not yet clear, and existing experiments are insufficient to fully demonstrate the superiority of the uncertainty-driven routing mechanism. This paper integrates language model-assisted concept generation, visual-language pseudo-supervision, concept bottleneck learning, deep concept reasoning, knowledge distillation, and uncertainty-driven selective prediction into a unified framework. However, these component technologies are all closely related to existing research, and the paper needs to more clearly explain its substantial innovation compared to existing concept models and neural symbol selective prediction methods. Furthermore, selective symbol prediction is one of the core contributions of this paper, but existing experiments mainly demonstrate that the routing model can achieve high symbol coverage while maintaining overall accuracy, without fully demonstrating that the proposed uncertainty-driven routing strategy has a significant advantage over standard confidence routing or other selective classification strategies. 2. The clinical reliability of medical concepts and the standardization of imaging experimental demonstrations still have shortcomings. This paper uses language models to generate medical concepts and constructs pseudo-concept supervision through visual-language similarity, thereby avoiding expensive manual concept annotation. However, this process also introduces potential semantic bias and visual localization errors. Concepts generated by language models may not necessarily correspond to identifiable clinical signs in specific medical images, and high similarity obtained by visual language models cannot be directly equated with the actual existence of clinical concepts. Although the authors provided expert evaluations and concept deletion experiments, these experiments primarily verified the subjective rationality of concepts and their impact on prediction probabilities, and are insufficient to prove the clinical accuracy of concept predictions. Furthermore, the creation of some figures and the presentation of medical images in the paper are not rigorous enough. Particularly in the presented CT images, different examples seem to lack unified or clearly defined window width and window level settings. For research involving medical image analysis, image display standards are not only a typesetting issue but also relate to the reliable interpretation of qualitative results. The authors should clearly define the image display and preprocessing protocols and standardize the revisions of relevant figures and tables.
Questions for authors
- Independent Contribution to Uncertainty-Driven Routing Could the authors further explain the substantial advantages of the proposed DCR uncertainty routing mechanism compared to standard maximum prediction probability, prediction entropy, classification margin, or other selective classification strategies?
- Usability and Clinical Accuracy of Pseudo-Concepts This paper utilizes a language model to generate a medical concept vocabulary and obtains pseudo-concept labels through visual-linguistic similarity. However, the semantic plausibility of a concept does not necessarily imply its verifiable clinical authenticity in medical images. How do the authors strike a balance between reducing the cost of manual concept annotation and ensuring the clinical accuracy of concepts? Specifically, are there concept-level reference annotations verified by medical experts to quantitatively evaluate the Precision, Recall, or F1-score of concept predictions? For concepts generated by the language model but not reliably identifiable from images, are effective screening, calibration, or elimination mechanisms designed? Furthermore, how do these errors propagate to the symbolic reasoning and final prediction of DCR when concept predictions are inconsistent with clinical facts?
2 comments
In the newly submitted version of the manuscript, the revisions highlighted in blue include the image-level concept evaluation in Appendix T.4 (Tables 27 and 28), the visual-screening ablation and discussion of error propagation in Appendix H.3 (Table 9), and the clarifications on COVID-CT preprocessing and image display in Appendices G.1 and Q, respectively. The existing coverage-matched selector comparison is in Appendix V (Table 31).
Thank you for the careful review. We appreciate your constructive questions about selector quality, concept reliability, error propagation, and medical-image display.
Entropy versus other selectors. The coverage-matched table fixes the checkpoint, branch predictions, and DCR coverage within each seed, so it compares selector ranking rather than changing the fraction of symbolic assignments. Our contribution is to use DCR entropy to decide when the explicit rule branch supplies the final prediction. Margin performs better on BloodMNIST at 80% coverage and Chest X-Ray at 50%, and random routing also exceeds entropy at some high-coverage points. Among the three confidence-based selectors (MSP, margin, and entropy), entropy ranks first or ties for first at 10 of the 12 reported operating points. At 80% coverage it exceeds margin by 0.41 points on Chest X-Ray and 0.18 points on Fitzpatrick17k. For binary COVID-CT, entropy, MSP, and margin induce the same ranking up to ties. We therefore do not claim uniform or statistically significant superiority. The retrospective oracle remains higher, leaving headroom for better branch selection.
Concept correctness and filtering. Our annotation-free claim concerns training supervision; it does not mean that concept correctness is untestable. On the SkinCon-annotated subset of the Fitzpatrick17k test split, we evaluated concept-head predictions against expert per-image annotations. Across the 19 mapped concepts, macro precision, recall, and F1 were 0.73, 0.75, and 0.74, respectively (Table B). The visual-screening ablation covers four datasets and uses Qwen3-VL-32B-Instruct, a class-stratified 10% subset of training images, no validation/test images, removal only when a concept is judged absent in every sampled image, and five-seed retraining. Concepts removed and original/after-screening routed accuracy are: BloodMNIST 3 and 97.87/97.88; OCT2017 5 and 99.79/99.72; COVID-CT 1 and 92.06/92.21; CUB 6 and 79.41/79.40. The changes range from -0.07 to +0.15 percentage points. This four-dataset ablation is not claimed for Chest X-Ray or Fitzpatrick17k. The filter removed only concepts that the VLM judged absent from every sampled training image.
Table A — Macro AUROC
Table B — Concept-head metrics against official annotations
Table S — Visual-screening ablation
Error propagation. Concept errors can propagate through DCR literals to class scores and routing. Relevance filtering and entropy fallback provide partial mitigation only: a confidently wrong DCR output can pass the gate, and the predictive branch also consumes concept information. Existing deletion and intervention analyses measure sensitivity and functional editability, not clinical correctness. Appendix H.3 now states this limitation explicitly.
Medical-image display. We standardized panel dimensions, annotation boxes, labels, and bar scales. We preserved image aspect ratios and applied no additional brightness or contrast adjustment. The COVID-CT dataset README states that the original Hounsfield unit (HU) values were lost when CT images were reproduced in publications. We therefore could not apply a common HU-based window width and level to the released images shown in our figures. The examples should therefore be read as retrospective methodological illustrations, not evidence of diagnostic equivalence or clinical readiness.