- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether commonly used dictionary-learning metrics for learned neural concept spaces can serve as reliable proxies for human comprehensibility. The authors extract class-specific concept spaces from ResNet representations using NMF and evaluate them using six automatic metrics, including reconstruction fidelity, sparsity, representation diversity, and stability. These metrics are then compared against five human-centered measures obtained from four complementary tasks covering informativeness, understanding, and distinguishability. The human study involves 351 participants and 5,616 responses. The main finding is that the relationship between automatic metrics and human evaluation is highly metric- and task-dependent. Reconstruction-based metrics and stability show little consistent alignment with human judgments, while Gini Sparsity and Representation Diversity exhibit stronger associations with linguistic measures such as label consensus. Based on these results, the paper argues that dictionary-learning metrics should be treated as diagnostic indicators whose relevance needs human validation, rather than as universal proxies for interpretability.
Critical strengths
- The paper addresses an important and under-validated assumption in concept-based interpretability. Automatic structural metrics are widely used to compare learned concept spaces, yet it is unclear whether improvements in these metrics correspond to concepts that humans can actually understand. Directly testing this relationship is valuable, and the paper identifies a meaningful gap between representation-level evaluation and human interpretability.
- The human evaluation is reasonably broad and carefully designed. The study evaluates concept spaces through multiple complementary tasks rather than relying on a single subjective interpretability score. The use of 351 participants, several behavioral measures, leave-one-class-out analyses, and multiple-comparison corrections makes the empirical investigation substantially more convincing than a small qualitative user study. I also appreciate the authors' cautious framing of the proposed measures as diagnostic tools rather than a new benchmark.
Critical weaknesses
- Limited statistical support for the strongest positive conclusions. Although the human study contains a large number of participant responses, the core correlation analysis is conducted over only 12 concept spaces. This results in limited statistical power. Moreover, none of the 36 metric-measure associations reaches q<0.05after Benjamini-Hochberg correction, including the strongest Gini Sparsity–Label Consensus association (q=0.055). I therefore think the positive findings should be framed more consistently as suggestive or exploratory rather than as validated indicators of human comprehensibility.
- Limited generalizability of the empirical setting. The evaluation is restricted to concept spaces extracted using a single backbone, NMF, a fixed K=5, and 12 image classes. Since the paper draws broader conclusions about dictionary-learning metrics for learned concept spaces, it remains unclear whether the observed relationships persist across different concept extraction methods, concept granularities, architectures, or datasets. A sensitivity analysis over K, or an additional extraction method, would substantially strengthen the claims.
Questions for authors
- Generalization across concept extraction settings. How sensitive are the reported metric-human correlations to the choice of K, backbone, and factorization method? Even a limited sensitivity analysis over several values of K, or an additional concept extraction method, would help clarify whether the observed relationships are specific to the current NMF setup.
- Multiple-comparison correction. Could the authors clarify which statistical tests they consider confirmatory? In Table 6, Label Consensus × Gini Sparsity has q=0.055when correcting over the 36 measure-metric comparisons, while the paper reports q=0.012when correcting globally over 102 tests. Please explain the rationale for these different correction families and why the larger global family produces a smaller adjusted value. I would also encourage the authors to explicitly distinguish corrected significant findings from suggestive trends in the main text.
- Reliability of the human measures. Could the authors provide uncertainty estimates or bootstrap confidence intervals for the human-evaluation measures and the resulting correlations? This would be particularly helpful for interpreting the mostly null results from the visual tasks and determining whether they reflect a genuine lack of association or limited measurement sensitivity.