- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper presents a theoretical treatment of prompt injection using information-theoretic tools (hypothesis testing, KL divergence, finite-sample confidence bounds), together with some experiments on small open models measuring how often injected instructions are followed and how detectable attacked outputs are. Beyond this, I was unable to identify a precise contribution: the results are stated in largely non-standard terminology, and I could not map them onto well-defined claims.
Critical strengths
Prompt injection is an important problem.
Critical weaknesses
- Writing is very hard to understand. The meaning of a lot of sentences is obscured by liberal use of (to the best of my knowledge) non-standard terminology, e.g., in the abstract alone "output laws," "injection capacity bound," "protected-event data processing," "zero-rate clipping."
- Experimental evaluation is limited to very small models (at most 1.5B). Furthermore, evaluation is not executed on (indirect) prompt injection/instruction hierarchy benchmarks (e.g., AgentDojo/InjecAgent/IH-Benchmark), making it hard to understand what situation this is intended for.
Questions for authors
- In what precise settings is this setup relevant, and can you provide experiments that showcase this on the relevant benchmarks?
Thank you for the detailed response and additional 32B experiments. I appreciate the authors' efforts, particularly the larger-scale evaluation and clarification of the output-only certification.
However, I still have several concerns:
Theorem 5 and empirical evidence: The 32B experiments demonstrate canary disclosure and distributional separation, but do not directly validate the practical relevance of Theorem 5. Please clarify how these results support the main theoretical contributions.
Black-box applicability: Reproducing certificates from archived labels does not fully establish practical applicability. Please clarify how violation labels can be obtained from observable outputs and how the framework could be applied to real-world APIs.
Statistical guarantees: Please clarify what the KL lower certificates imply for prompt injection security and the independence assumptions required for their validity.
LoRA and computational cost: Please provide the corrected role-spoofing results and a more quantitative discussion of the trade-off between sample size and certification strength.
Overall, I remain positive about the theoretical contributions, but the connection between theory, empirical evidence, and practical applicability needs further clarification.
I will maintain my current rating (Weak Reject) for now, but I am open to reconsidering it if these concerns are adequately addressed.