- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper first discovers a \textit{layer-feature specificity trap} that points out that no single metric can detect the backdoor across layers and attack methods. Upon this discovery, it proposes \textbf{LatentPrism}, a defense framework that finds the optimal subspace of the vector space consisting of six backdoor-detecting metrics by minimizing the Davies–Bouldin Index of binary clustering results generated by Gaussian Mixture Model, and then purifies the victim model by two tracks. The authors also conduct experiments on three LLMs and five attack methods.
Critical strengths
- This paper proposes a method that can automatically select proper layers and metrics that have potential indication of attacks.
- The experiments cover three LLMs and five attack methods, providing extensive empirical results.
Critical weaknesses
- This paper lacks theoretical evidence on the composition of the six metrics. NAV and CHI are functions of IRD and GMD (which directly come from RepGuard), resulting in underlying collinearity in the 6-dimension manifold. Low DBI only means dense clusters that are distant from the main cluster, while it doesn't guarantee the separation of semantically poisoned samples. Moreover, \textit{LatentPrism} is not compared with RepGuard, a should-be baseline.
- Section 5.2.2 and Algorithm 1 are inconsistent with the code (
defenders/defender_LatentPrism.py) provided by the authors. The paper implies a two-step process, where GMM is employed after finding the minimal DBI ofbinary clustering'', while in the code implementation, thebinary clustering'' is GMM itself. The code performs the optimization by brute-force grid search, also greatly hindering the efficiency (the GMM optimization process accounts for over 30% of the execution time in my test).
Questions for authors
- What assumptions on the distribution of the projection features do you take that can ensure that the GMM clustering can identify the poisoned group? Specifically, how does your method handle cases where the benign minority cluster is smaller than the poisoned cluster, given your vanilla assumption that the smaller cluster is the poison?
- Can you state the reason why you don't compare LatentPrism with RepGuard in your experiments, set IRD + GMD as a baseline, or conduct ablation experiments on the effect of different metrics?