- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a label impurity regularizer for supervised concept discovery using sparse autoencoders (SAEs). The objective encourages consistent factor activations within each class, and an unbiased minibatch estimator is derived for efficient optimization. The authors further adopt binary activations through HTAF. Experiments on ImageNet-1K, CUB-200, and Places365 evaluate classification accuracy, semantic alignment, and concept coherence.
Critical strengths
1.Simple and efficient formulation. The proposed objective incorporates class supervision without requiring concept-level annotations. The unbiased minibatch estimator makes the regularizer practical for SAE training.
2.Improvements from label supervision. SAE+LI consistently improves classification accuracy over vanilla SAE across three datasets and two CLIP backbones (Table 3). The qualitative examples also suggest that some learned factors capture recognizable visual attributes.
Critical weaknesses
-
Limited methodological novelty. The method mainly adds a class-conditional activation consistency regularizer to an existing SAE framework, while HTAF is adopted from prior work. The objective is closely related to minimizing within-class activation variance. Its advantage over existing supervised representation learning approaches is not sufficiently established, and the absence of an HTAF-only ablation makes it difficult to isolate the contributions.
-
Insufficient evidence for improved interpretability. Table 4 primarily relies on CLIP-based semantic similarity, which does not directly measure whether the discovered factors are human-interpretable. The qualitative results are also selectively presented. Moreover, the full method underperforms SAE+LI in classification accuracy across all six settings in Table 3. Stronger independent evaluation is needed to justify the claimed improvement in concept quality.
Questions for authors
-
Eq. (3) also favors factors that are constant within each class. What ensures that the model learns meaningful visual concepts rather than simply class-specific representations?
-
Table 4 relies on CLIP similarity, while Section 3.4 uses class labels to name concepts on CUB-200. Can the authors validate the improvements using independent concept annotations, such as CUB-200 attributes?
-
Tables 3–4 omit the SAE+HTAF baseline without label impurity, and Appendix D does not report concept quality for SAE+CE. How do these baselines compare with the proposed method on concept quality?