- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
BackX evaluates attribution methods by planting a backdoor and treating the trigger as a known cause. Trigger recall measures how much of the trigger the top-ranked attribution pixels cover. A second test replaces those pixels with pixels from the clean image and checks whether the attack success rate falls. The paper states four fidelity criteria, scores prior benchmarks on them, and gives BackX 3.5 against 2.5 for the existing neural-Trojan benchmark and 3.0 for Null Feature / CLEVR-XAI. It then compares nine attribution methods on CIFAR-10, GTSRB, and ImageNet under Blend and ISSBA, and argues for one standardized setup of post-processing and output type.
Critical strengths
The paper is easy to follow. Figure 2 states the five-step pipeline, and the criteria in Section 2 give the reader a checklist before the experiments. The setup study is also informative: absolute value versus signed scores, and logits versus probabilities, change results for the same method. The visibility result is concrete. Making the trigger more visible does not improve trigger recall, and the poisoning rate has little effect.
Critical weaknesses
The benchmark’s central move is already published. Lin, Lee, and Celik, “What do you see? Evaluation of explainable artificial intelligence interpretability through neural backdoors” (KDD 2021), use a neural Trojan as attribution ground truth. BackX’s own Table 1 gives that line 2.5 and itself 3.5. The gap is produced by the authors’ four criteria. On input-distribution invariance, BackX marks itself only partial: recovering an image by swapping in clean pixels still changes the input. The explained model is the Trojaned model. A public preprint of this work has been available since May 2024 (arXiv:2405.02344, v2 in October 2025) and still leads with the claim of being the first fair setup. Relative to KDD 2021, the new pieces are the checklist, a watermark Blend trigger, and a sweep of setup choices. That is not enough for a new benchmark at this venue.
The experiments do not lock the setup that the third contribution depends on. The body explains probabilities with CAM methods and logits with gradient and integration methods, and takes absolute values for gradient methods. The appendix instead explains probabilities with integration methods. The visualization captions use logits for CAM and integration methods, and absolute probabilities for gradient methods. ISSBA on ImageNet is dropped because random attributions can already recover the attack, so a drop in attack success rate on that setting does not show that the map found the trigger. There is no table that ranks the same methods under BackX and under Lin et al. (2021). Gradient and integration methods beat CAM, and which of those two wins depends on the dataset. That is a useful sensitivity study of known explainers on Trojaned models.
Questions for authors
Please point to one protocol sentence that matches the body, the appendix, and the figure captions at the same time. On the methods you share with Lin et al. (2021), which ranking changes under BackX, and which of their ground-truth failures does BackX correct? I would need both answers in the main text before this was more than an extension of that KDD paper.
4 comments
Response to Reviewer DXys (Part 2/2)
W2&Q1. Evaluation consistency and comparison with NeuronTrojan.
We thank the reviewer for pointing out these typos, which we have corrected. The main text, appendices, and figure captions now consistently describe the unified attribution setup used throughout our experiments. Table R2 provides details of the explained output and post-processing used for each method.
Table R2. Unified attribution settings.
| Attribution methods | Explained output | Post-processing |
|---|---|---|
| GCAM, FG | Output probability | Original values |
| Grad, GGCAM, SG | Output logit | Absolute values |
| IG, IG-Uni., AGI, LPI | Output logit | Original values |
To further isolate the contribution of the individual designs in BackX, we compared all nine attribution methods under BackX and individual component ablations, alongside NeuronTrojan. Each ablation replaces one BackX component with the corresponding NeuronTrojan design: fully visible triggers during training (α=1), class recovery rate (RR) scoring, or bounding-box recovery (BBox). As shown in Table R3, BBox recovery causes the largest individual ranking shift (τ=0.167), crediting explanations for trigger pixels outside their selections. RR scoring also changes the ordering (τ=0.778), while training with α=1 yields τ=0.833. NeuronTrojan yields τ=0.056 across nine methods and τ=0.048 for the seven shared methods, excluding Guided Grad-CAM and LPI. These comparisons highlight the contribution of BackX to benchmark fidelity. This ablation analysis and its interpretation have been incorporated into Section 8 of the revised manuscript.
Table R3. Component ablation analysis of BackX and NeuronTrojan. Parentheses show changes relative to BackX.
| Attribution method | BackX | α=1 | RR scoring | BBox recovery | NeuronTrojan |
|---|---|---|---|---|---|
| Grad-CAM | 9 (-0) | 9 (-0) | 9 (-0) | 2 (-7) | 1 (-8) |
| FullGrad | 7 (-0) | 8 (+1) | 8 (+1) | 6 (-1) | 6 (-1) |
| Guided Grad-CAM | 3 (-0) | 2 (-1) | 4 (+1) | 1 (-2) | 2 (-1) |
| AGI | 6 (-0) | 6 (-0) | 6 (-0) | 5 (-1) | 4 (-2) |
| SmoothGrad | 1 (-0) | 1 (-0) | 1 (-0) | 3 (+2) | 3 (+2) |
| LPI | 5 (-0) | 4 (-1) | 2 (-3) | 4 (-1) | 5 (-0) |
| Integrated Gradients | 8 (-0) | 7 (-1) | 7 (-1) | 9 (+1) | 9 (+1) |
| IG-Uniform | 2 (-0) | 3 (+1) | 3 (+1) | 7 (+5) | 7 (+5) |
| Input Gradients | 4 (-0) | 5 (+1) | 5 (+1) | 8 (+4) | 8 (+4) |
| Kendall’s τ vs BackX | 1.000 | 0.833 | 0.778 | 0.167 | 0.056 |
Looking forward to further feedback
We thank the reviewer again for the careful review and constructive feedback. With the discussion period nearing its end, we would be grateful if the reviewer could take a look at our responses and let us know whether the concerns have been addressed. This would allow us to address any remaining concerns before the discussion closes.
For convenience, we briefly summarize the main additions already reported in our responses and incorporated into the revised manuscript.
-
Controlled fidelity validation (W1). We conducted an additional controlled oracle experiment to directly validate BackX’s fidelity improvements over NeuronTrojan. With analytically known feature contributions, BackX correctly distinguishes explanations with different true contributions that NeuronTrojan’s metrics score identically.
Manuscript updates: The new experiment and its analysis are now included in Section 4 (Figure 3). -
Head-to-head comparison and component ablations (W2 & Q1). We conducted additional head-to-head comparisons and component ablations across nine attribution methods. The results reveal substantial ranking discrepancies between NeuronTrojan and BackX and expose evaluation biases that undermine the reliability of NeuronTrojan’s method comparisons. BackX addresses these fidelity limitations to provide more reliable attribution benchmarking.
Manuscript updates: The additional comparisons and ablation analyses are now included in Section 8 (Figure 10). -
Unified evaluation protocol (W2 & Q1). We corrected the typos concerning explained outputs and attribution post-processing.
Manuscript updates: The main text, appendices, and figure captions now consistently describe these unified settings.
Our earlier responses and the revised manuscript provide the supporting results and detailed explanations. We hope these additions and clarifications address the main concerns, and we would be very grateful if the reviewer would consider updating the rating in light of these additions.
Reply
Thanks, But I will remain my score.
Response to Reviewer DXys (Part 1/2)
We sincerely thank the reviewer for the close reading and constructive feedback. We address each concern in turn below and hope our responses clarify our work and adequately address the reviewer's questions and concerns. The manuscript has been revised to include the supporting experimental results and explanations, with updates marked in blue.
BackX contributes a fidelity framework supported by theoretical guarantees and controlled validation, alongside standardized benchmarking, multimodal coverage, and new attribution insights. Specifically, BackX’s contributions fall into two main areas. 1. Fidelity framework and theoretically grounded benchmark design. BackX introduces four fidelity criteria and connects benchmark design to explicit theoretical guarantees. Its analysis bounds input shift and the effect of mask leakage, while watermark training, clean recovery of selected pixels, and sensitive metrics address the corresponding sources of evaluation error. 2. Standardized benchmarking, multimodal coverage, and attribution insights. BackX standardizes attribution post-processing and explained outputs, reducing confounding effects in method comparisons. The benchmark covers 15 attribution methods and 5 attack families, with evaluation spanning both vision and language. These systematic comparisons reveal how spatial resolution, smoothing, and reference and path construction affect attribution performance across evaluation settings. BackX thus provides a consistent basis for method comparison and broader insights into attribution behavior across attacks and modalities.
We further validated our design using a CNN with one convolutional layer and predefined weights, making pixel contributions to the target logit analytically computable. Oracle attribution masks with equal pixel budgets remove 20%, 50%, and 80% of the total target logit contribution. As shown in the table below, NeuronTrojan assigns identical IoU and original class recovery rate (RR) scores, whereas BackX logit and probability reductions distinguish all three levels correctly. This controlled comparison provides direct evidence of improved metric fidelity against analytically known contributions. These results show that improved fidelity comes from the evaluation design of BackX, rather than through the backdoor mechanism alone. We have added this experiment and its setup details to Section 4 of the revised manuscript.
Table R1. Evaluation scores for oracle explanations with known contributions.