- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper is trying to investigate whether agentic LLMs encode internal signals that can be used to detect indirect prompt-injection (IPI) attacks. The authors use linear probes on pre-generation hidden states to detect IPI exposure and identify a knowledge–action gap, where models may encode attack-related signals but fail to translate them into safe actions. The authors propose Action-Guiding Reasoning Intervention (AGRI), which uses probe scores to selectively trigger defensive reasoning. The paper also introduces Mind-Reader QA to analyze the concepts associated with the detected latent signals. Experiments across multiple LLMs demonstrate strong probing performance under various held-out settings, while defense evaluations show reduced attack success rates and improved clean-task utility.
Critical strengths
- The whole framework of this paper is highly complete. The authors conduct extensive experiments across multiple LLMs, including held-out attacks, instructions, task suites, and additional generalization tests. The consistently strong probing results provide meaningful evidence that IPI exposure information can be decoded from model hidden states.
- The proposed AGRI framework uses hidden-state probe scores to selectively trigger defensive reasoning. Experiments show substantial reductions in attack success rates across multiple models, while probe gating generally preserves better clean-task utility than always-on intervention.
Critical weaknesses
- The first question is related to the claimed contribution. While the linear probes achieve strong detection performance, it remains unclear whether they capture genuine awareness of prompt-injection risks or simply recognize instruction-related patterns in tool outputs. The current experiments do not fully distinguish these possibilities. This limits the evidence supporting the paper's interpretation of the latent signals and the proposed knowledge–action gap.
- The always-on AGRI already achieves substantial reductions in attack success rates, suggesting that the defensive reasoning intervention itself plays a major role. Although probe gating improves clean-task utility, the paper lacks a direct comparison with simpler text-based detectors used to trigger the same intervention. Can the authors add additional ablation to support this?
Questions for authors
These questions mainly relate to the weaknesses mentioned above. Clarifying these concerns would help me better assess the paper's contributions and potentially reconsider my recommendation.
- How can the authors distinguish whether the linear probes capture genuine prompt-injection risk information or simply recognize instruction-related patterns in tool outputs? How would the probes perform on benign tool outputs containing instruction-like content? Could the authors provide additional evidence or analysis to support the interpretation of these latent signals?
- Could the authors clarify what additional benefits hidden-state probing provides when comparing with using a simpler text-based injection detector to trigger the same reasoning intervention as alternative?
Round-2 Response to Reviewer JcLT
Dear Reviewer JcLT,
Thank you for taking the time to follow up. We appreciate hearing that the new detector comparisons addressed your concerns about hidden-state probing.
Regarding your concern about interpretation, we are now aware that some wording in the submission, such as “either direct IPI-exposure sensing or indirect operational cues” in the abstract, may have caused confusion. We are deeply sorry that this wording did not reflect our intended claims. We do not intend to claim that these signals precisely encode prompt-injection awareness or any other specific concept. In fact, our interpretation analysis in Section 5 offers initial insights into what these signals may represent and suggests a complementary possibility, namely that multiple underlying features may jointly support IPI detection.
We'd like to revisit our intended arguments in a more reader-friendly fashion.
In the first rebuttal round, we made the following revisions to clarify our interpretation.
In this round, we made further revisions to clarify our interpretation.
We do understand you may be busy at this time. If you have a chance before the discussion period ends, we would be grateful to hear whether these clarifications address your remaining concern. We would be happy to discuss any point further.
Best regards,
The authors of Submission 1173