- Rating
- 1
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies whether explanation quality in image classification depends mainly on model accuracy, architecture or XAI method. The authors train 26 CNNs, vision transformers and hybrid architectures from scratch on ImageNet-S50 under one training setup and evaluate five attribution methods with twelve performance metrics at eight checkpoints per model. They report that accuracy drives localization, while faithfulness, complexity and randomization depend mostly on the XAI method. They also find that perturbation methods overtake gradient methods on transformers during training but not on CNNs, and that normalization layers affect explanations more than model size.
The paper addresses a recent and important topic. I have, however, strong doubts on the validity of the paper with respect to AI generation artifacts, see below, for which reason I recommend a rejection.
Critical strengths
The study design is the paper’s main strength: training all 26 backbones from scratch under one regime and scoring explanations along the full training trajectory separates the effect of accuracy from that of architecture, which comparisons of converged off-the-shelf models cannot do. The choice of a multi-category metric suite, together with an explicit analysis of metric redundancy, is very helpful.
Critical weaknesses
The paper seems to contain hallucinated and incorrect references, which raises the question do which degree this paper actually the paper was quality checked after the draft had been generated by AI (see AI usage statement at the end of the paper).
In particular: "Kilian Göller, Haadia Amjad, Steffen Seitz, Carsten Knoll, and Ronald Tetzlaff. How a model’s architecture and performance influences explainability: A study of Grad-CAM and CRAFT in CNN-based image classification. In Explainable Artificial Intelligence (xAI), 4th World Conference. Springer, 2026." This paper seems not to exist. However, in the paper mentions Göller et al. (2026) as one of only two cited works that evaluate explanations across training checkpoints. The paper is thus core related work this submission builds upon and delineates from. The authors describe it as narrow in scope (two XAI methods, three CNNs, no transformers). Since this reference appears to be hallucinated, the paper’s account of its most closely related work cannot be trusted.
Further potential hallucination artifacts can be found here: (b) "Deevyankar Agarwal, Mario Alberto Berbís, Antonio Luna, Vivian Lipari, Julien Brito Ballester, and Isabel de la Torre-Díez. Automated medical diagnosis of Alzheimer’s disease using an EfficientNet convolutional neural network. Journal of Medical Systems, 47(1):57, 2023." This paper exists, but the second author is Manuel Álvaro Berbís, not Mario Alberto Berbís. (c) "Anna Hedström, Leander Weber, Dilyara Krakowczyk, Dina Bareeva, Franz Motzkus, Wojciech Samek, Sebastian Lapuschkin, and Marina M-C Höhne. Quantus: An explainable AI toolkit for responsible evaluation of neural network explanations and beyond. Journal of Machine Learning Research, 24(34):1-11, 2023a.". This paper exists, but the third and fourth authors are Daniel Krakowczyk and Dilyara Bareeva.
These examples indicate that the AI generated draft was not properly validated and raises the question to which degree the content itself was checked by a human. I thus have strong doubts on the validity of the work since principal related work it builds upon seems not to exist. My conclusion is that the paper is thus not yet ready for publication in a top-tier conerence.
Questions for authors
I recommend the authors to closely review (at least) the related work and to fix AI-generation artifacts. Or, in case I am wrong, please provide the Göller et al. paper or a publisher link to proove its existance.
Response to Reviewer QAWh (Part 1/3)
We thank the reviewer once again for the constructive review and for the clarifying reply to our questions. Below we answer each point. Section, figure and table numbers refer to the revised paper we uploaded.
CW1: Localization as headline metric; sensitivity of faithfulness to the perturbation strategy
Localization. We agree that agreement with an object mask is not by itself a good explanation. It measures plausibility (does the map point where a human expects the evidence?), not faithfulness. The revision says so in a new Discussion paragraph, "Limitations due to metrics" (Section 7); see also our answer to Q2. We keep localization AUC as the headline localization metric because its chance level (0.5) is independent of the image. We no longer present localization as the headline of explanation quality as a whole:
Faithfulness. We added Pixel Flipping (Bach et al., 2015) next to IROF, Faithfulness Estimate and Faithfulness Correlation. It sharpens one conclusion:
So deletion scores compared across checkpoints or models largely reflect the model's confidence.
Perturbation strategy. Following the reviewer's clarification, the new Discussion paragraph addresses this topic directly.
We did not run insertion or alternative fill strategies in the limited time available.
CW2: Hyper-parameters of the XAI methods; improved method variants; positioning
Hyper-parameters. We agree that the explanations depend on them. Every non-default setting is listed in Table 3 and described in Appendix B, and a single fixed setting is used for all models and checkpoints. Each deviation from the Quantus and Captum defaults was based on a measurement:
Improved variants. A new related-work paragraph acknowledges that improved successors exist, for example LIME and SHAP with coalitions from hierarchical or foundation-model segmentations (Knab et al., 2025; Sun et al., 2023). It also explains why we keep the general-purpose methods in their standard form: so that differences can be attributed to accuracy, architecture and method family rather than to method-specific tuning. As the reviewer suggested in Q3, we also tested more recent, architecture-adapted methods on selected architectures:
This refines Finding 2. Generic gradient methods (Grad-CAM, IG) fall behind the perturbation methods on transformers, but the better of LeGrad and LibraGrad beats both perturbation methods on all nine transformers, and LRP with AttnLRP rules draws level with them (Section 5).
Positioning. We fully agree with the reviewer's reply: explanation faithfulness, sensitivity to methodological choices, and the link between model characteristics and explanation quality are well-established concerns. The revision now says explicitly that we do not claim this sensitivity as new (Section 2). Our contribution is the joint, controlled measurement of how much accuracy, architecture and method each contribute, and how they interact.
CW3: Why do the patterns exist?
Each finding (Sections 4 to 6) is now structured as Observation, Interpretation and Implication; the Interpretation paragraph explains why we think the pattern arises. We present these as hypotheses consistent with our data and with prior work.
(continued in Part 2)