- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MoE-SGT, a language-guided graph reasoning framework for concept bottleneck models (CBMs). The method integrates editable concept predictions with offline-generated question–answer knowledge through answer–concept and answer–question graphs. It employs present/absent concept embeddings, graph attention with semantic and co-occurrence priors, and a structure-aware mixture-of-experts module with shared and sparsely routed experts.
The model is evaluated on four single-label classification datasets (CUB-200, ImageNet, CIFAR-10, and CIFAR-100) and two medical multi-label datasets (MIMIC-CXR and CheXpert). The reported results outperform the evaluated CBM baselines across these datasets. Additional experiments investigate concept prediction, test-time interventions, module ablations, and computational efficiency. On CUB-200, the method achieves 80.31% Top-1 accuracy, increasing to 86.39% with ten graph-informed concept corrections and 89.92% under oracle correction.
Critical strengths
1. Meaningful integration of language knowledge and editable concept reasoning.
The paper presents a coherent framework for combining offline class-level QA semantics with sample-dependent concept evidence. The use of present/absent concept embeddings and answer-conditioned graphs provides a reasonable mechanism for incorporating both positive and negative concept evidence. Importantly, concept corrections can update candidate retrieval and graph predictions without retraining, which is valuable for interpretable and interactive classification.
2. Extensive empirical evaluation and encouraging intervention results.
The evaluation covers six datasets, including natural-image and medical-image classification. The proposed method consistently outperforms the evaluated CBM baselines. The concept intervention experiments are particularly encouraging: on CUB-200, ten graph-informed corrections improve accuracy from 80.31% to 86.39%, outperforming uncertainty-only and random selection. The ablation studies also provide evidence that graph reasoning, language knowledge, and sparse experts contribute to predictive performance.
Critical weaknesses
1. Limited methodological novelty and insufficient isolation of the main contributions.
The proposed framework combines several established techniques, including concept embeddings, graph-based reasoning, language-guided representations, and sparse mixture-of-experts routing. Although their integration is reasonable, the paper does not clearly establish which components constitute a substantive methodological advance beyond prior graph-based CBMs and related architectures. In particular, the distinction from GraphCBMs and existing graph Transformer approaches deserves a more rigorous analysis. The current ablations demonstrate incremental performance gains but do not fully isolate the necessity of answer-conditioned QA reasoning or structure-aware expert routing.
2. Insufficient experimental rigor to establish robust and fairly controlled improvements.
All main results are reported using a single training seed, without standard deviations or confidence intervals. This is particularly concerning on CUB-200, where the improvement over Sparse-CBM is only 0.34 percentage points. Furthermore, some baselines use different concept acquisition and supervision procedures, making it difficult to attribute performance differences exclusively to the proposed reasoning architecture. The frozen-feature probe also outperforms the proposed model on all six datasets, and the paper does not sufficiently quantify the resulting accuracy–interpretability trade-off. Stronger controlled comparisons and multi-seed evaluations are needed to substantiate the claims.
Questions for authors
-
Novelty and architectural necessity: How does MoE-SGT differ fundamentally from GraphCBMs and existing graph Transformer-based reasoning approaches? Can the authors provide a controlled comparison using the same concept features and supervision, replacing the proposed answer-conditioned graph architecture with a simpler concept graph Transformer?
-
Statistical reliability: Can the authors report results over at least three independent training seeds, particularly on CUB-200, where the improvement over Sparse-CBM is only 0.34 percentage points? Are the reported gains consistent across runs?
-
Fairness of baseline comparisons: Since the baselines use different concept acquisition and supervision protocols on several datasets, can the authors provide comparisons under a unified concept vocabulary and supervision setting? This would help isolate the benefit of the proposed reasoning module.
-
Accuracy–interpretability trade-off and expert routing: Given that the frozen-feature probe outperforms MoE-SGT on all six datasets, how do the authors justify the additional architectural complexity? Can they provide matched-parameter and matched-compute comparisons together with intervention performance, especially against a dense graph Transformer and a feature-only MoE router?