- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors propose AgentSiphon, a RAG agent attack framework consisting of "trigger-conditioned retrieval", "agent-mediated acquisition", and "HGA-based covert generation". The overall idea is that an attacker-controlled content can cause the agent to retrieve a protected document (since it has the authority to do so, unlike the attacker), and following this, under gray-box settings, information on the protected document can be transmitted to the attack through HGA. The main novelty, as i understand, is combining retrieval poisoning and steganographic methods to attack RAG agents.
Critical strengths
- Method seems plausible and potentially effective
The paper proposes using HGA-based covert generation to extract information following an indirect prompt injection attack. Such an attack seem plausible in gray-box settings, motivating further research into security mechanisms mitigating such attacks.
- Clear empirical results
Results presented in the paper indicate that AgentSiphon works well under the assumed setting.
Critical weaknesses
- On writing
Although HGA is a central component of AgentSiphon, the paper does not detail sufficient information on how it works in the AgentSiphon scenario to encode hidden payloads into the generation. The paper does not read in a self-contained way, and should be revised to incorporate such information.
Questions for authors
- Minor typo
Line 048: "... privileged operations x Ruan et al. (2024)"
4 comments
Typo at line 048
Thank you for catching this issue. We have corrected the citation formatting in the Introduction.
The corrected passage reads:
"Existing work studies related pieces of this problem. Agent security and information-flow research examines tool use and privileged operations (Ruan et al., 2024; Costa et al., 2025; Kolluri et al., 2026), while steganographic methods hide information in generated text (Fang et al., 2017; Ziegler et al., 2019; Silva et al., 2024)."
This appears in Section 1, page 1, lines 048–051 of the revised manuscript.
Additional improvements
In response to the other reviews, we have also made three additions that may be useful context for the reviewer:
- A worked example showing the complete pipeline through a concrete trigger and acquired field (Section 5, page 6).
- A prompt-injection defense experiment evaluating acquisition under a manually written, non-adaptive defense (Section 6.3, Table 3, page 9).
- A comparison with the three closest data-exfiltration attacks, clarifying the differences in attacker capabilities, secret acquisition, and transmission mechanisms (Table 1, Section 2, page 4).
Thank you for identifying the presentation issues and for the suggestions that helped us clarify the method. Kindly Let us know if any more clarifications.
Follow Up
Thank you again for your helpful feedback and for the suggestions on improving the presentation of our work.
We have expanded the explanation of HGA, including its underlying mechanism and how it is incorporated into AgentSiphon. We have also added a complete algorithm describing the attack pipeline and addressed the presentation issues identified in your review.
In addition, we have incorporated a worked example and further experimental clarifications arising from the other reviews.
We would be grateful to know whether these additions have sufficiently addressed your concerns or whether there are any further aspects that you feel require clarification.
If you find the revisions satisfactory, we would sincerely appreciate your continued consideration of our submission.
Thank you once again for your time and constructive feedback.
HGA is not self-contained
We thank the reviewer for pointing out that HGA, despite being central to the method, was not explained in sufficient detail for readers to understand it independently of the cited work.
We have expanded Section 3 (pages 3–4) to describe the hash-then-greedy vocabulary partition, the bias parameter β, the eligibility threshold η, and the seeded decoding procedure. We also explicitly clarify that HGA is unrelated to hierarchical graph methods.
Algorithm 1 (Section 5, page 6) now presents a complete AgentSiphon episode, covering Activate, Acquire, Transmit, and Recover. This provides a self-contained description of how the mechanism is used in our framework without requiring readers to consult Silva et al. (2024) to follow the overall procedure.