- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper changes the output target used by LRP from the winning logit to its difference from the average of selected competing logits. This aims to explain relative preference rather than absolute score, while keeping the propagation rules unchanged. Validation covers language and vision tasks, using insertion/deletion-style perturbation tests, comparisons with attribution baselines, and sensitivity analysis of the number of competitors.
Critical strengths
The paper identifies a meaningful mismatch between explaining an absolute logit and explaining relative preference. The proposed seed is easy to integrate into existing LRP methods. The perturbation results show substantial gains in some settings, such as CodeJudge generation AUAC increasing from 0.4019 for AttnLRP to 0.5060.
Critical weaknesses
Better perturbation scores do not establish that the method better explains the original decision. With a large k, the target becomes the winner’s advantage over an average of many alternatives, rather than its nearest decision boundary. The supporting reparameterization control also uses a different k = 2 seed from the main definition. Together, these leave the central explanation claim less well supported than the reported performance suggests.
Questions for authors
- Which seed was actually used for Table 3: z1 − z2 or z1 − 0.5z2? The main definition and Appendix B disagree. Does the reported control therefore test the stated RI-LRP method?
- For large k, what evidence shows that the attribution better explains the original decision, rather than a different contrastive target? Please clarify how the AUAC evaluation distinguishes these interpretations.
Reviewer's responses to authors
Dear reviewers,
If not done already (thank you - rev. Nx3d ), could you please take a look and reply briefly to the "Official Comment(s) by Authors" / Rebuttals, possibly by an acknowledgement that you have seen it.
Feel free to respond in more detail, in particular, if you have further questions or opinions to the replies from the authors.
With best regards, an AC