- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies how advertisers can manipulate interactive LLM recommendation assistants when a user-side auditor can inspect the full runtime context including system prompt, retrieved passages, and final answer. The proposed method, Subliminal-OPD, transfers the target preference into model weights through on-policy distillation from a teacher that is the same base model under a promotional system prompt, using only semantically unrelated numeric queries and student-generated rollouts.
Critical strengths
-
The paper defines a decision-relevant joint objective for covert advertising: success weighted by the probability of escaping a full-context audit. Detection is explicitly conditioned on promotion success, and aggregation over RAG variants is made explicit. This is a cleaner and more honest way to score stealth than reporting promotion success or detection rates separately.
-
The evaluation is broad for this topic: three model scales, nine comparison methods (ten rows including OPD), RAG and no-RAG settings, five context variants, three disclosed LLM auditor prompts plus a deterministic context rule, and a judge-independent four-encoder distribution-shift analysis with a permutation-based finite-sample floor.
Critical weaknesses
-
The choice of training prompts is insufficiently justified. In Figure 1, the authors combine recommendation scripts with semantically unrelated instructions, but do not explain why preferences learned from these prompts should transfer to other settings. It is also unclear whether using semantically related instructions would produce different results. A comparison would help clarify the role of the unrelated instructions.
-
The intended recommendation behavior and training target need clarification. Is the goal to make the model recommend specific products, or simply to increase the frequency of recommendations when users ask questions? Clarifying this distinction would make the method’s objective and evaluation easier to interpret.
-
From my perspective, the main contribution of this paper is applying OPD to LLM recommendation. The core difference between OPD and Subliminal-OPD is the prompt input into the teacher.
Questions for authors
-
In the no-RAG setting, Appendix C.4 defines Tied-Full as the product of Tied and Full for each variant, calculated over the matching success scope. However, several no-RAG entries do not match the value obtained from the displayed columns. For example, for Llama Natural Sys, , whereas the reported value is 1.1.
-
Could you report detection by at least one additional judge family (or a small human audit) for the Subliminal-OPD vs. Subliminal-SFT and vs. Plain comparisons, to support the stealthiness claims beyond the single frozen judge?