- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces FisherCBM, a concept bottleneck model that uses a variant of an optimal transport formulation to derive concept values from input tokens. This hard concept representation is combined with a per-concept residual that can encode input information beyond the binary concepts, but is limited in how much and from which parts of the input it can encode information. Together, FisherCBM is a CBM variant that preserves the intervenability of hard CBMs, but maintains competitive performance with soft and logit-based CBM variants.
Critical strengths
- This work introduces a CBM that integrates an optimal transport formulation into the concept representation to obtain most of the advantages from hard and soft CBMs: better and clearer interventions, and good downstream performance, while also localizing concept information to specific parts of the input.
Critical weaknesses
- The readability and clarity of the paper can be improved. The method section can be difficult to follow at times, and the description of experimental results is often written in a convoluted way with unnecessary information.
Questions for authors
- Q1: l. 149: Why should the excess information be in general less localizable than the concept?
- Q2: Could the approach be adapted beyond binary concepts or make use of categorical concept information in a better way? Currently, the concepts are all individually treated, but the relevant tokens for all belly-color tokens should be the same ones. And is there a way to adapt the approach to continuous concepts?
- Q3: You introduced the parameter in Eq. 8, but this parameter seems to be always set to one in the evaluations. Can the author discuss this parameter and under what circumstances changing it from one would be sensible?
- Q4: The AwA token visualizations (in C.3) show that the token representation moves towards a general class representation when there are class-level concepts. As far as I understand it, the token-level localization of the concepts only works properly if there is sufficient per-sample variance in the concept annotations. Is there a way to find out how much of this variance is needed to form proper per-concept token representations instead of only class-level token representations?
- Q5: For the CelebA experiments, why is it desirable to recover around one-third of the performance gap to the black-box model, but not all of it? Is it clear that the other models include the two hidden attributes in their concept space, and how can FisherCBM guarantee that this information is not present in its residual?
- Q6: l. 452: What means an area of 93.9% equal to CEMs?
- Q7: I do not understand the insights of the intervention experiment, in particular the "wrong" interventions. While the performance should drop by making more and more concepts incorrect, the speed at which the performance drops is difficult to compare between models, as, for example, the robustness of the concept predictor also plays into this.
- Q8: What do the "wrong" interventions on the concept groups look like? Setting them to an arbitrary different value would make more sense, but having different possibilities, while flipping all concepts in the group would result in an invalid state.
For the results section in the main text and the appendix, the quality of the text could be improved. In its current version, the text is often convoluted and repeats a lot of information that can already easily be read from the respective figures or tables. Instead, the text should focus more on the actual insights that can and should be drawn from the results.
I think there are some related works that should be considered in the context of this work:
- In the context of concept leakage, I think the works [1, 2] should be discussed, as they both also discuss the information leakage problem from different perspectives.
- Considering localization of concept information, it might be interesting to discuss [3] as well, which also localizes information in the input, but with a different approach.
- This work [4] further provides a good discussion and motivation for several points of this work, so it might also be valuable to include.
Furthermore, I think it would be helpful to differentiate more clearly between the function of the per-concept residual introduced in this work and what is typically considered a residual connection in the CBM literature. While the residual in this work is an addition to the hard, 1-bit concept representation and operates on a per-concept level, it is typically considered a separate part of the CBM, e.g. a side-channel, where information is controlled to complement the concept set, more to target completeness of the concept set [5, 6].
This work would benefit from a discussion of FisherCBMs advantages and limitations. While most of the paper is used to derive the mathematical details of the method, making the advantages clear (to some extent via experimental evidence, but also with a more general discussion), and being open about potential limitations of the work would be helpful.
Minor Points:
- l. 161: abbreviation IUCT is not introduced (is only introduced in l. 174)
- In the final version, ensure that the reference does not break over pages (currently happens at the end of page 2)
[1] Zarlenga, Mateo Espinosa. "In Defense of Information Leakage in Concept-based Models." International Conference on Machine Learning (2026). [2] Almudévar, Antonio, José Miguel Hernández Lobato, and Alfonso Ortega. "There was never a bottleneck in concept bottleneck models." International Conference on Learning Representations. 2026. [3] Jeon, Sujin, et al. "Locality-aware concept bottleneck model." arXiv preprint arXiv:2508.14562 (2025). [4] Knab, Patrick, et al. "What’s in the bottle? a survey and roadmap of concept bottleneck models." Transactions on Machine Learning Research (2026). [5] Shang, Chenming, et al. "Incremental residual concept bottleneck models." 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2024. [6] Yuksekgonul, Mert, Maggie Wang, and James Zou. "Post-hoc concept bottleneck models." arXiv preprint arXiv:2205.15480 (2022).
5 comments
Q8. Validity of incorrect group interventions.
The group-wise CUB evaluation follows the CEM setting, while the original incorrect-intervention protocol flips selected binary attributes as . We acknowledge that this can produce invalid categorical assignments.
We therefore conducted an additional experiment replacing each selected group with a different group state observed in the CUB training annotations, without retraining any model. This preserves valid within-group configurations, although the resulting combination across groups need not correspond to an observed class. At full intervention, FisherCBM and Hard CBM fall to 0.04% and 0.01% accuracy, respectively, whereas CEM retains 7.1% and CEM without RandInt retains 68.5% (Fig. 5). Although the original bit-flip protocol produces a sharper decline, the substantial difference between FisherCBM and CEM persists under valid group-state substitutions.
Additional Comments: Related Work, Clarity, and Limitations.
We have expanded Sec. 2 to discuss recent leakage analyses (Zarlenga, 2026; Almudévar et al., 2026), locality-aware CBMs (Jeon et al., 2025), and related concept-residual approaches. Unlike a separate residual side channel, FisherCBM attaches a bounded residual to each hard concept coordinate, preserving its identity under interventions. We have also added Algorithm 1, clarified the intervention metrics and terminology, and expanded the discussion of limitations, including part-level grounding, the Fisher penalty's effective regularization scale, incomplete concepts, and the current binary formulation.
I thank the authors for their responses to my review. Most concerns have been addressed. It would be nice to highlight changes in the paper during the rebuttal with text in a different color, which would make it easier to check the paper and identify updated and changed parts. Below are some remaining points:
Role of .
- Do you have any results where is needed? Because if this parameter might be helpful in some theoretical circumstances, but never in practice, it could also be dropped from the method to make it a bit simpler and easier to understand.
Interpretation of incorrect interventions:
- The predictors of Fisher-CBM and CEM still differ and also affect the outcomes. I agree that a difference between 4.8% and 47.7% is quite large and unlikely to be affected only by this, but I still think this fact should be discussed when presenting and discussing the experiment.
Response to Reviewer kqHM
We thank the reviewer for the detailed questions and constructive suggestions. We have revised the manuscript to clarify the theoretical scope, intervention protocols, and limitations.
Q1. Why is excess information less localizable?
Excess information is not inherently less localizable; it may itself have a localized source. The issue is that concept supervision does not specify where this additional information should originate. We have clarified this distinction in Sec. 3.1. Transport exposes the token sources of concept evidence, while Fisher regularization constrains the residual's off-support sensitivity.
Q2. Categorical and continuous concepts.
Lemma 1 establishes independence of concept-wise transport optimization, not statistical independence of concept labels or disjoint spatial supports. Related concepts can therefore share tokens, as illustrated by the belly-color concepts in Fig. 1. Our current formulation treats concepts as independent binary attributes without enforcing categorical constraints. Extending it to categorical and continuous concepts would require modified readouts and corresponding generalizations of the capacity and intervention guarantees, as discussed in the Conclusion.
Q3. The role of γ.
We use γ=1 throughout to avoid dataset-specific tuning. Increasing γ suppresses low-belief residuals more strongly, whereas smaller values transmit more continuous information. Theorem 4 quantifies the corresponding gate contraction when correcting confidently wrong concepts. The intervention-direction guarantee holds for any γ>0 with η<1/2. We have added this explanation after Eq. (8).
Q4. How much per-sample variation is needed?
CUB also uses class-level concept annotations, obtained through majority voting, yet its transport plans exhibit strong object-level localization: 91% of the mass lies inside the bird bounding box, with part-level pointing outperforming the evaluated baselines (Table 10; Appendix C.3.1). This shows that within-class variation in concept labels is not strictly necessary for spatially concentrated transport. We believe concept discriminability may be more relevant: distinguishing visually similar bird species can encourage reliance on localized attributes, whereas in AwA2, species-level cues may suffice to predict class-level attributes (Appendix C.3.3). However, this does not guarantee correct part-level grounding, and determining how much instance-level supervision is required would need a controlled study. We have clarified this distinction in Appendix C.3.3.
Q5. Incomplete-concept CelebA.
Recovering approximately one-third of the accuracy gap is an observed outcome, not a predefined target. We do not claim that competing models explicitly represent hidden attributes as concepts. Table 4 measures their decodability: for Wavy Hair, ROC-AUC is 0.888 from CEM embeddings, 0.791 from ProbCBM embeddings, and 0.730 from our full bottleneck, compared with 0.712 from ground-truth concepts.
We also do not claim that our residual contains no hidden information. Theorem 2 bounds only the identity channel to one bit per concept. The residual is bounded in amplitude and regularized in off-support sensitivity, but is not guaranteed leakage-free. We have clarified this trade-off in the revision.
Q6. Intervention AUC.
Intervention AUC is the mean task accuracy over all nonzero intervention levels (Appendix B.4). On CUB, FisherCBM achieves 93.9±0.1, compared with 94.0±0.3 for CEM (Table 3). We have replaced "equal" with "comparable" and clarified the definition in Sec. 4.2.
Q7. Interpretation of incorrect interventions.
The full incorrect-intervention accuracy is used as a behavioral indicator of reliance on intervenable concept states, rather than a direct information-theoretic measure of leakage. We agree that AUC is partly affected by clean accuracy, which is why Table 3 also reports half- and full-intervention accuracy.
On AwA2, FisherCBM and CEM have nearly identical clean task accuracy (96.1% vs. 95.9%) and concept accuracy (both 99.2%), yet retain 4.8% and 47.7% accuracy, respectively, after half the concept groups are corrupted under the original protocol. Our additional CUB evaluation using valid alternative group states further addresses the protocol concern: at 14/28 corrupted groups, FisherCBM retains 25.8% accuracy versus 62.9% for CEM (Fig. 5). These results support greater reliance on intervenable concept states without equating incorrect-intervention accuracy with a direct leakage measure.