- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes ISN, an immune-inspired framework for continual backdoor defense. The key idea is to extract shared class-conditioned residuals from semantically conflicting poisoned samples as “antigens,” learn corresponding “antibodies,” and reuse them to detect and mitigate recurrent backdoor behaviors across tasks. The framework combines a frozen semantic encoder, multiple receptor types, training-time correction/neutralization/vaccination, and immune memory. Experiments on continual image classification benchmarks show strong reductions in attack success rate while largely preserving clean accuracy.
Critical strengths
-
The paper presents a different perspective on continual backdoor defense by modeling shared residual patterns rather than focusing only on explicit trigger appearance.
-
The proposed framework covers several stages of the defense pipeline, including semantic screening, antibody construction, mitigation, and cross-task memory.
-
The experiments suggest that the method can reduce ASR while maintaining competitive clean accuracy on the evaluated benchmarks.
Critical weaknesses
-
My main concern is that ISN needs high-confidence semantic conflicts as antigen seeds before it can fit a new antibody. This creates a tension with one of the paper's main motivations, namely detecting semantically consistent or clean-label backdoors. If a new attack only produces label-consistent poisoned samples and therefore provides few or no semantic-conflict seeds, ISN cannot establish a new antibody unless a compatible mature memory already exists.
-
No adaptive attack against ISN is considered in this paper.
-
The experiments mainly show transfer across different source classes under the same attack configuration. For example, the antibody learned from poisoned bird/horse samples is tested on poisoned target-class samples carrying the same BadNets or WaNet trigger. Therefore, it is still unclear whether the learned “antigen” captures a trigger-independent malicious behavior, or simply a class-conditioned signature of that specific trigger. A stronger evaluation would vary the trigger pattern, location, or attack realization while keeping the target behavior unchanged, and test whether the same antibody still transfers.
-
The claim that immune memory transfers across attack families is not directly demonstrated. Different attacks are mainly handled by different receptor pathways, which is weaker than showing that an antibody learned from one attack can transfer to another.
-
The method relies heavily on the frozen semantic encoder to identify conflicts, define clean references, and assign pseudo-labels. Its robustness when the encoder itself makes semantic mistakes is not sufficiently studied.
-
The setting is limited to class-disjoint Task-IL with known task identity at inference. It does not cover harder settings such as Class-IL or unknown task identity.
-
The attack coverage is relatively narrow. The main experiments focus on BadNets, WaNet, and LTB, with fixed poisoning settings; more diverse poison rates, targets, dynamic triggers, and multiple simultaneous backdoors are missing.
-
The paper seems to rely quite heavily on manual \vspace adjustments to fit the content, which leads to several noticeable spacing issues
Questions for authors
see weaknesses
7 comments
Response to Reviewer h4Y2 #2
W1. Acquiring an antigen when the semantic discovery gate supplies no usable hypothesis
The revised experiment creates the failure mode you identify under an effective attack and shows that a complementary acquisition route restores protection. We separate the availability of semantic evidence from whether an attacker has changed the ground-truth label. The former is the operational input to Eq. (4).
The submitted mechanism first transfers evidence across samples within an attack. Sec. 3.3, p. 4, describes that process:
Immune perception operationalizes this evidence transfer in three steps: it exposes cross-class seeds, fits their recurring non-self response through complementary receptors, and uses validated antibodies to screen same-class data.
Thus, label-consistent poisoned samples are a population to be recognized after a detector has been acquired. They need not reveal themselves through label disagreement. Sec. 3.3, p. 6, states:
Semantic consistency provides the retained label, and antibody evidence determines intervention.
In the additional first-task experiment with reliable seeds, poisoned Vanilla has 92.48% conditional ASR, while ISN has 0/1,000 at 99.95% CA. ISN starts with empty memory, obtains 800 poisoned examples among 805 conflict seeds, and admits one local antibody. This establishes that historical memory is unnecessary when current evidence supports acquisition.
We then test natural failure of the current seed gate. The first task contains 9,680 training images and 968 label-flipping poisons with a fixed 3×3 white patch. With its fixed reference split, the attack target produces zero semantic-conflict seeds. The other class produces five clean conflicts, below the minimum support of six. Neither class provides an accepted hypothesis. The original ISN then acquires the backdoor, with 92.00% unconditional ASR and 91.98% conditional ASR.
To address this bottleneck, the complementary route proposes recurring local patterns from images and observed labels, checks recurrence on a separate training fold, and screens candidates against trusted clean references. This route obtains candidate evidence directly from the stream without consuming conflict seeds. The filtered stream then enters the ISN learner.
| First-task condition | CA (%) | Unconditional ASR (%) | Conditional ASR (%) |
|---|---|---|---|
| Clean ISN | 99.90 | 0.10 | 0.00 |
| Poisoned ISN | 99.80 | 92.00 | 91.98 |
| Poisoned ISN with class-matched random removal | 99.80 | 91.90 | 91.88 |
| Poisoned ISN with revised screening | 99.95 | 0.10 | 0.00 |
The screen and random-removal arms delete exactly 1,026 images under the same observed-class quotas, retain 8,654 images, and perform 2,710 main optimizer updates. Screening removes all 968 poisons and 58 clean examples. Random removal removes 164 poisons, leaving 804 in training. The 91.80-percentage-point unconditional ASR gap between the two arms therefore isolates selection quality at the fixed retained-data and update budget. Poison identities are used retrospectively to count removals.
The combined acquisition experiment uses 120 distinct trusted examples per class, including 60 additional examples beyond the three-split supplementary implementation. We report this budget with the result. The test uses label-flipping poisons and naturally absent usable target seeds. The acquisition rule itself uses images, observed labels, recurrence, and clean references. These inputs also define how the branch operates when the observed labels are correct. We will state the empirical composition and the discovery condition separately in the revised method and abstract.
We will incorporate the complementary acquisition rule into Sec. 3.3 and state its inputs, recurrence checks, clean calibration, and trusted-data budget. Appendix E.2 supplies the separate test of evidence transfer from an exposed subset to hidden samples carrying the learned residual.
Response to Reviewer h4Y2 #3
W2. Defense-aware search with an active antibody and newly fitted victims
We now test an attacker that jointly seeks target induction, semantic-conflict evasion, and affinity evasion against a surrogate containing an active target antibody. This directly exercises the detector state relevant to your concern.
The surrogate admits one local spatial antibody for the target. The attacker performs a single-start, 40-step SPSA search, with 121 optimization queries and two verification queries. Its objective combines target cross-entropy with penalties for semantic exposure and antibody affinity. Candidate selection uses training-side data, followed by frozen-candidate evaluation.
Across the 40 recorded updates, affinity penalties decrease while target cross-entropy increases. The initial joint loss is 6.62286, and the smallest loss among the recorded updates is 6.68086. The selection procedure therefore retains the initial white patch. This trajectory records the actual optimization trade-off. A successful evasion candidate must preserve target induction as well as lower detector response.
On an independent reporting holdout from the training data, the fixed surrogate detects all 20 triggered source-class examples in the union of its two signals. Semantic conflicts cover 18/20, and the antibody covers 5/20. These counts show how the complementary detection signals operate on the same attack cohort.
We then freeze the selected candidate and repeat the four-arm victim evaluation with complete separation of trusted references. Each victim's anchor, validation, and calibration sets have zero overlap with every trusted-reference role, optimization set, and selection set of the source surrogate. The victims share the architecture, pretrained backbone, underlying corpus, and training seed with the surrogate. New LoRA parameters and classification heads are fitted after the candidate is frozen. Each checkpoint receives one official first-task test evaluation after its training-side counts are reproduced.
| Newly fitted victim | Training condition | CA (%) | Unconditional ASR (%) | Conditional ASR (%) |
|---|---|---|---|---|
| Vanilla LoRA | Clean | 99.95 | 0.00 (0/1,000) | 0.00 (0/1,000) |
| Vanilla LoRA | Poisoned | 99.80 | 92.00 (920/1,000) | 91.98 (917/997) |
| ISN | Clean | 99.90 | 0.00 (0/1,000) | 0.00 (0/999) |
| ISN | Poisoned | 99.90 | 0.00 (0/1,000) | 0.00 (0/999) |
Each victim uses 60 trusted examples per class (120 total), split into 20 anchors, 20 validation examples, and 20 calibration examples per class. It trains for ten epochs on 8,680 images, with 868 poisons delivered in each poisoned arm. Each uses SGD 0.01, batch size 32, gradient accumulation 1, and 2,720 main optimizer updates. ISN's auxiliary heating stage is recorded separately.
Poisoning raises the undefended victim's unconditional ASR by 92.00 points. Under the same selected trigger, ISN reduces 920/1,000 successful attacks to 0/1,000 and raises CA from 99.80% to 99.90%. Clean and poisoned ISN both achieve 99.90% CA and zero successful attacks. These four arms quantify attack learning and the defense effect with fully separated trusted references.
We will report the search budget, objective, active-antibody state, selected pixels, and reference relationships explicitly. The selected patch remains the initial patch after the specified search. The result records the outcome of that defense-aware search and its transfer to newly fitted victims.
Response to Reviewer h4Y2 #1
Dear Reviewer h4Y2,
Thank you for the detailed review and for recognizing the shared-residual perspective and the observed defense performance. We have added controls that directly exercise the acquisition bottleneck, evaluate a defense-aware search with an active antibody, and replay its frozen candidate on newly fitted victims. We also use the submitted mechanism experiments and new reference interventions to clarify what is transferred and how semantic errors affect training. The added experiments use CIFAR-10 and seed 42. We identify unconditional ASR and the paper's clean-conditioned ASR separately throughout.