- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes a new explanation framework PA-XAI, which enforces data constraints in explanations for network intrusion detection systems. The core hypothesis is that feature attribution methods don't consider validity constraints on inputs, and therefore produce misleading explanations that operators cannot trust. The paper modifies LIME, SHAP, IG, and DeepLIFT to consider these constraints, and compares them to their base-variants in different settings.
Critical strengths
The paper raises an interesting and underexplored problem. Without constraints, perturbation-based explainers evaluate models on inputs that can be outside the valid data range. This seems a relevant issue, even beyond the particular chosen setting. The paper shows that envofcing these invariants changes which explainers score best in the evaluation.
The empirical evidence is broad, including four datasets, three classifiers, and four explainers.
Critical weaknesses
The experiments don't support the central claim. The paper claims that PA outputs are "the corrected measurement," but PA changes the explainers themselves. Without ground-truth attributions, we cannot measure which explainer is better. PA-LIME’s negative faithfulness is equally consistent with PA-LIME being a worse explainer as with the paper’s reading that PA exposes LIME’s true unfaithfulness. The only thing the experiments can establish is that the two explainers differ, in both directions. Which one is better is assumed by definition without evidence.
The significant is limited. The paper motivates operator trust and practical application constraints in multiple places. However, it is never defined who the operator is, which decisions are influenced by the explanations, and how those decisions improve with the proposed framework. Furthermore, the feature extraction setting for NIDS is outdated. It relies on hand-crafted flow features from old lab-generated datasets (NSL-KDD was derived from 1998 traffic), and much of the recent work has moved towards models trained on raw traffic. It is unclear if the paper's conclusions transfer to more up-to-date settings.
Several headlines results look like artifacts. For example, LIME's perfect stability of J=1.0 on 2 datasets for all three classifiers. The consensus result is across related methods, especially IG and DeepLIFT, so high correlation is expected. Additionally, it is unclear which exact constraints were used, and if they only cover theoretically impossible aggregates, or also consider protocol validity (which can and often is violated by attackers).
Questions for authors
Please list the full constraint set per dataset. Are constraints enforced on the raw or the normalized feature space? Are there real training flows that violate these constraints, or could there be observed traffic that does, even malformatted?
Is the faithfulness measurement subject to the same constraints? If not, the faithfulness metric itself evaluates the model on invalid flows, which PA-XAI is meant to address.
How can we conclude that the explanations actually improved?