- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper aims to improve existing model-agnostic XAI methods by introducing concept-level inputs. In particular, unlike earlier work, e.g., LIME, that rely on unsupervised methods to extract text corpus or visually coherent visual patches for downstream operations, the proposed method leverages LLMs or SAM segmentation models to localize words and object masks for diverse concepts. The resulting inputs are then fed to the original XAI methods to generate the corresponding explanations. Experimental results show that the method is able to achieve favorable improvement on several concept-related metrics.
Critical strengths
(1) It is an important problem to enhance attribution-based XAI methods by incorporating more interpretable concepts.
(2) The proposed method is model-agnostic and does not rely on additional annotations.
(3) The paper considers a collection of tasks for evaluation, which is useful for achieving a comprehensive understanding of the method.
Critical weaknesses
(1) While the paper repeatedly emphasizes the need of concept-level perturbation for existing XAI methods, it is generally not a new idea to incorporate concept-based features/inputs with model-agnostic methods (e.g., ConceptLIME already explores the integration). The proposed method essentially replaces feature extraction modules in prior methods with an LLM or the SAM segmentation model, and has rather limited technical novelty.
(2) While Table 2 and 3 show considerable improvements, all of the baselines are relatively old and rely on weaker feature extraction approaches. As a result, it is not surprising that using more advanced LLM/Segmentation would result in higher accuracy.
(3) Related to the previous comment. The paper compares with other concept-based methods in Table 4. Nevertheless, these methods typically rely on different forms of inputs for perturbation. How do the authors ensure a fair comparison with consistent inputs? Section 4.2.2 states that concept-level neighborhood is used, but its technical definition is unclear.
(4) The evaluation metrics (e.g., accuracy) examines whether the specific concepts are removed or detected after diverse perturbation methods. It does not verify whether the perturbation affects the other concepts within the original scenes. The method uses a diffusion model for perturbation, and might introduce/remove other concepts.
(5) The human evaluation appears to be insufficient to me. In particular, it only takes into account 10 samples per task (5 for testing). Only two models are compared, and the test images are generated with concept-level perturbation that could be more favorable for the proposed method.
Questions for authors
(1) Please elaborate on the concept-level and feature-level neighborhoods, and how they are used during the evaluation.
(2) What are the key advantages of the proposed method over recent ones that also consider concept extraction?