- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors ask whether the combinations of concepts an LLM will get wrong can be predicted from how it represents each concept on its own, without running the combined input, and call this goal Adversarial Concept Search (ACS). Their score, compositional interference (CI), measures how closely the representations of the concepts being combined are aligned, an idea they motivate with compressed sensing. For the LLMs, the representations are first centered within clusters of similar inputs. They test CI on small Transformers trained on SCAN and on two-hop questions and multilingual fact recall, each with three LLMs, checking with accuracy curves and PR-AUC whether the highest-CI combinations are the ones the model gets wrong.
Critical strengths
-
On SCAN, where the training data are known, the authors test CI against simpler explanations: how often each concept and each pair of concepts appear in training, how long the command is, and whether other models trained on the same data give the same ranking. CI holds up against all three.
-
To score a combination, CI needs only the representations of the single concepts, not the combined input. The multilingual setup shows why this is useful: an English vector for each fact and a subspace for each language are enough to score every fact-language pair, which would otherwise have to be translated and tested one by one. This also sets the method apart from An & Du (2026) and Blum et al. (2025b), which need representations of the combined examples.
Critical weaknesses
-
The pooled two-hop result does not separate failing compositions from hard task types. The model succeeds mostly on one cluster pair (str_str), so a ranking that only separates the pairs beats the pooled baseline, and the within-pair results (Fig. 24) use the uncentered CI and show little gain on str_str.
-
The LLM experiments lack a baseline that does not rely on geometry. The model's confidence on the atomic answers also needs no composed input, and Press et al. (2023) found that it predicts two-hop success, but CI is compared only with an uninformative ranking and other similarity measures. For multilingual recall, a mismatched-language subspace would show whether the language part of CI matters.
Questions for authors
-
What are PR-AUC and point-biserial r for the centered CI within each cluster pair or dataset? A clear within-dataset gain would resolve my first concern.
-
Does CI add predictive value over the model's confidence on the atomic answers, and does a mismatched-language subspace predict multilingual failures as well as the matched one?
3 comments
Please let us know if we have addressed all the concerns raised in the review. If it does, we would appreciate your reconsideration of the score. Let us know if there are additional questions and we are happy to answer them.
Thank you for your rebuttal. My first concern also remains: two-hop success is concentrated in str_str (accuracy about 0.46 against below 0.10 for the other pairs), and the within-pair increase over the baselines are small. Besides, given the overall quality of the paper, I tend to maintain my score.
Response to Reviewer 3eKg
Thank you for recognizing the novelty and practical utility of the work. We provide clarifications and additional experiment results here. All additions will appear in the updated version of the paper.
W1, Q1. Within-cluster correlation Fig. 24 explicitly shows that each cluster group succeeds (high correlations and PR-AUC beating the baselines). Thus, the observation that “The model succeeds mostly on one cluster pair (str_str)” is a misread of the results. We show the within-cluster correlations and the fact that pooling them together hides the correlation between CI and failures, a classic case of Simpson’s paradox. To fix the statistical paradox, we center the representations, making the clusters comparable to each other.
To confirm that our predictions work for all subgroups after cluster mean-centering, we ran additional experiments. See the table below, where CI outperforms the baseline significantly on all individual subgroups except str-year, which might be more challenging because it is extremely imbalanced (LLM fails at 97.2% of combinations), suggesting that the LLM may not be generalizing compositionally on this subset at all. We will add these detailed results into the Appendix.
W2, Q2. Separating English fact difficulty from fact-language interference
We test whether using the matching language subspace improves failure prediction. For each model and target language, we evaluate whether using the target language’s subspace to predict the failures works better than using other languages’ subspaces. Although the statistical power of this test is very small, at least for Qwen2.5-14B, predictions from the matching subspace performed significantly better than those from mismatched subspaces. These results were not significant for the smaller Llama models (3B or 7B), which could be due to low statistical power. Another reason for the insignificance might be that smaller models are worse at multilingual transfer generally, weakening the accuracy of predictions that assume compositional transfer.
However, we also report new experiments to confirm that CI captures more information than just English fact difficulty in General Response to All Reviewers. We compare to new baselines such as English fact confidence and English fact representation norm. CI beat confidence and norm baselines in multilingual setup in the majority of the models and languages, suggesting that CI is capturing information beyond English fact difficulty. We will include these details in the updated Appendix.