- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work investigates corpus‑poisoning attacks on RAG systems. By tracing the flow of retrieved evidence through the residual stream of several LLMs, the paper discovers a six‑layer residual evidence band that carries answer‑bearing information and causally shifts the competition between attacker and correct answers. The paper then compares two oracle interventions: steering and position‑aligned restoration (replacing the band with the exact clean residuals). The results show that steering suppresses most attacks but recovers only around 13% of correct answers, whereas restoration restores around 72%, demonstrating that suppression is not correction.
Critical strengths
- Across five core models and three additional architectures the authors locate a contiguous six‑layer residual band whose replacement with clean states reduces the attacker-correct margin. This work presents a cross-model causal analysis of RAG poisoning, identifying concrete potential architectural targets for future defenses.
- The paper presents a clear empirical separation between “suppression” and “correction”. The experiment results challenge the implicit assumption that eliminating the attacker’s signal is sufficient for effective defense; it demonstrates that restoring legitimate, answer-bearing signals is equally essential.
Critical weaknesses
-
One of the main concerns on this paper is that the restoration heavily rely on the availability of clean-run activation of the same query, which is largely impractical in real-world deployments. Without a practical, non-oracle restoration mechanism, the paper provides limited actionable guidance for developing real-world defenses.
-
The experiment scope is confined to short-form, greedy QA generation. Clean and poisoned prompts greedily generate at most eight tokens. The eight‑token analysis is adequate for short, greedy QA but does not demonstrate that the residual‑evidence band remains influential throughout longer generation or multi‑turn dialogues (which is especially important for RAG). Therefore, the paper’s claim of a universally persistent causal pathway is not sufficiently supported by the current evidence and should either be qualified as applying primarily to early-generation stages or substantiated through additional experiments involving longer generation sequences.
-
The proposed lightweight attribution and detection mechanisms are not universally applicable. They work only for models that exhibit strong head concentration but cannot cover models such as In Llama 2‑7B and DeepSeek‑7B. This undermines the claim of a broadly usable internal signal.
-
The paper would benefit from a clearer comparison with ShieldRAG. Although these approaches operate at different stages of the RAG pipeline and are not direct baselines for causal tracing, they provide useful reference points for evaluating the practical implications of the proposed findings. In particular, the authors should clarify whether their causal insights offer additional defensive benefits beyond existing retrieval-stage approaches, especially given that their restoration experiments rely on oracle access to clean activations.
Questions for authors
- Can you discuss the possibility of a practical, non‑oracle restoration method based on the findings of this paper?
- How does the residual evidence band behave during longer generation (e.g., multi‑turn dialogue or document summarization)? Have you measured whether the band’s causal influence persists beyond the first few generated tokens, especially when the model attends to newly generated context?
- What is the performance of your single‑head attribution method on models that lack a strong poison‑grounded head (e.g., Llama 2‑7B, DeepSeek‑7B)? Could a multi‑head or full‑layer aggregation recover comparable document localization accuracy for these architectures?