- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper investigates global concept sparsity in unsupervised CBMs. The main motivation is that existing approaches use a large concept vocabulary while enforcing sparsity only at the input or class level, and reducing the size of the global vocabulary may improve interpretability and reduce information leakage. To do this, the paper proposes Global Concept Gating (GCG), a method that learns a task-specific subset of concepts via a sparse mask shared across all inputs and classes. The classifier is then retrained with the selected concepts, effectively reducing the global vocabulary while also preserving most of the classification accuracy.
Critical strengths
Reducing bottleneck size while keeping accuracy is a useful improvement over state-of-the-art CBMs, although a bit incremental in my opinion, especially for DN-CBM where oversizing the bottleneck is by-design to allow for task-agnosticism.
Critical weaknesses
The benefit of reducing the global concept vocabulary is not demonstrated. The main motivation and claim of the paper is that a large concept set is problematic for interpretability and information leakage, but there is not enough evidence to support this claim. Regarding interpretability, the main evidence is a few examples in Figures 5 and 6 where top concepts account for most of the prediction after GCG, however this depends on sparsity at the input and class level, rather than the vocabulary size. Other CBMs such as VLG-CBM and M-CBM already provide such concise explanations while maintaining larger concept vocabularies. Furthermore, the paper reports a small improvement in similarity with CUB attributes before and after applying GCG to DN-CBM and claims better semantic grounding, however DN-CBM deliberately learns task-agnostic concepts and therefore it is not particularly surprising that selecting a task specific subset results in higher alignment with concepts annotated for that dataset and this does not demonstrate that concepts are more semantically grounded or interpretable or easier to audit. Regarding information leakage, the paper compares selected concepts against random projections at different bottleneck sizes, but this only shows that the selected concepts are more predictive than random projections, not that leakage is reduced. A given concept bottleneck can beat random projections significantly but still have substantial leakage, as it was shown for VLG-CBM in the M-CBM paper. Additionally, all these experiements were done only against DN-CBM, which as I already mentioned, has a large bottleneck by design to make the bottleneck task-agnostic, a property that would naturally not be conserved after applying a task-specific selection.
Questions for authors
N/A
3 comments
[W4] Evidence for better semantic grounding
Thank you for this comment. We agree that our original grounding evaluation was coarse, because its concept-to-attribute mapping dropped body-part information (e.g. "has wing color::olive" became "olive").
In response, we have added experiments on standard (vanilla) CBMs trained on CUB's 312 annotated attributes (Section 4.6). There, every concept has a known meaning and a ground-truth label, so grounding can be measured directly.
- Concept accuracy is preserved. In sequential and independent CBMs, the concept predictors are unaffected by the gate. In the joint CBM, GCG removes 73.7% of the concepts at a cost of only 1.8 points of concept accuracy (Table 3).
- The concepts stay meaningful to the model. The gated models are also still responsive to concept interventions (Figure 9).
[W5] Evidence for reduction in leakage
In response, we have added a controlled test in which every concept has a known meaning. We trained standard CBMs (sequential, independent and joint) on CUB's annotated attributes, with and without GCG. We then measured concept–task leakage (CTL) and inter-concept leakage (ICL) following Parisini et al. (2025). These metrics quantify the information that predicted concepts carry about the task, or about each other, beyond what the ground-truth concept labels carry. Our new results, summarised in Section 4.6, suggest that both leakage metrics are reduced when GCG Is applied to the vanilla CBM. This shows that GCG can reduce leakage while maintaining a smaller vocabulary and without significant sacrifices to either task or concept accuracy.
[W6] Using DN-CBM as a benchmark
Thank you for this point. We chose DN-CBM because it has the largest concept vocabulary of the models we study: 8192 sparse-autoencoder concepts, learned without reference to the downstream task. This is precisely the setting in which an uncontrolled vocabulary is most problematic and in which global selection is most needed.
We acknowledge that DN-CBM's concept dictionary is trained on CC3M, which limits its accuracy on fine-grained datasets such as CUB (as its authors note). For this reason, our conclusions do not rest on DN-CBM alone.
- We evaluate GCG on three further CBMs whose concepts are built for each dataset (LF-CBM, UCBM and VLG-CBM).
- We have added experiments on standard CBMs trained on CUB's ground-truth attributes (see W4 and W5). These do not depend on DN-CBM's dictionary.
I thank the authors for the rebuttal and the additional experiments.
Regarding W1, if I understand correctly, the cited studies investigate cognitive limitations and the complexity of individual explanations, therefore it may hint at benefits for decision-level sparsity and explanation size but do not suggest benefits of global sparsity.
Regarding W2, I appreciate the correction to Figure 5, but this does not address my concern. A model can have highly concentrated contributions from a few concepts even with a large global vocabulary.
Regarding W3, I agree that global and decision-level sparsity are distinct, and I understand the motivation for improving global auditability, but the benefit of reducing the global vocabulary for auditability is still assumed rather than demonstrated.
Regarding W4, the new experiments on supervised CBMs show that concept accuracy is (mostly) preserved when applying GCG, but that does not demonstrate an improvement in semantic grounding.
Regarding W5, I appreciate the additional experiments on information leakage in supervised CBMs. However, the paper focuses on unsupervised CBMs, so it would maybe be more relevant to investigate the effect of GCG on information leakage in those models.
Regarding W6, as I mentioned in my initial review, the DN-CBM vocabulary is large by design to support reuse across tasks. Showing that it can be significantly reduced for a specific task remains somewhat trivial for DN-CBM specifically.
Overall, I appreciate the clarifications, but most of my concerns remain, and therefore I think my original score was adequate.
Thank you for taking the time to go over this work and provide us very useful feedback. We are glad you found that our work provides a "useful improvement" for state-of-the-art CBMs. Your suggestions and comments were very helpful for us improving our manuscript, and we hope we can address your remaining concerns in this reply.
We reply to your concerns and questions below and have updated our paper accordingly, marking new changes in blue. If you have further concerns, please let us know. Otherwise, we would sincerely appreciate it if you would consider updating your review in light of our replies below.
[W1] The benefit of reducing the global concept vocabulary is not demonstrated.
Thank you for raising this. We agree that the benefit of a smaller vocabulary is ultimately a claim about human understanding, which we do not measure directly with a user study. However, there is well-established evidence that it matters, and we refer to these studies in our Introduction (L53-74). We also restate the studies here:
Verifying a model as a whole means reviewing every concept it can use. Under these findings, a vocabulary of a few hundred concepts is far more feasible to review than one of 8192. Requiring a deployment study before accepting this would be like requiring that improved test accuracy be validated in deployment before it is taken as evidence. The proxy is standard because the link is well supported.
We have also added direct evidence that the smaller vocabulary is more useful in Section 4.6 and Appendix A.5:
[W2] Examples in Figures 5 and 6 depend on input-level sparsity rather than vocabulary size
Thank you for this observation. Our quantitative evaluation of effective concept size (Section 4.2) shows that the two are closely linked. To make this visible in the examples, we have updated Figure 5 to use absolute contributions, with "Other" as the summed magnitude of the remaining concepts, which avoids signed terms cancelling.
This shows that the baseline's explanation of a single image draws on a long tail of concepts from across its full vocabulary.
The per-input tail is therefore a consequence of the large vocabulary: a model that may use any of 8192 concepts spreads each decision across many of them. Reducing the vocabulary shortens that tail.
[W3] Other CBMs already provide sparse explanations while having large vocabularies
Thank you for raising this. We agree that per-input sparsity and vocabulary size are different properties, and we have attempted to explain this in the Introduction.
Our focus is global verifiability: being able to review every concept the model can use, across all inputs. For this, the effective vocabulary is what matters, not the per-input explanation size. A model can be sparse for each input yet draw on a different set of concepts each time.
This is what we observe in the existing sparse CBMs. In LF-CBM and UCBM, each prediction may come from a sparse set of concepts, yet the union of concepts used across the test set covers nearly the entire dictionary (Table 1).
GCG is complementary to input-level sparsity rather than a replacement for it. It bounds the set of concepts that any explanation can draw on, and it can be combined with the native sparsity mechanisms of these models.