- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes VisionLogic, a framework designed to explain vision models by grounding decision-relevant visual concepts. VisionLogic identifies compact feature sets that replicate the model's predictions, representing these features as predicates based on class-specific thresholds, and grounds these predicates in visual regions using an iterative procedure. The framework is assessed across different models and shows improvements in understanding model behavior through human evaluation compared to established methods.
Critical strengths
- This paper provides a large-scale (465) human evaluation, which measures humans’ ability to predict model outputs on unseen images with the help of explanations.
- The experiments are conducted on ResNet, ViT, ConvNeXt, and Swin, and demonstrate better results than baselines in human studies.
- Some interesting analysis about feature use and selection in classification models is carried out with the proposed explanation method.
Critical weaknesses
- Only human user studies are used to evaluate the proposed method compared with baselines and other concept explanation methods.
Questions for authors
- Is there any quantitative metric for the evaluation? Although user studies show that the explanation is indeed helpful for humans to better understand the model, I think that just using user studies is not sufficient for evaluating the faithfulness of the method, since human responses are usually noisy.
- The threshold is decided across the source images predicted as class c. So how does the number of source images influence the threshold, and the further analysis results and visualization results?
- How often do predicates activate outside their associated class?