- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
AdSteer integrates advertising into the decoding of a frozen language model. It retrieves ads through intent-oriented anchor phrases, indexes their keyword token sequences in a trie, and uses a four-state finite state machine to activate and release logit biases when generation enters a keyword. A lightweight SteerHead predicts bias strength and decay from hidden states and decoding-context features, with optional category-specific heads. Training regresses to targets constructed by rescaling fixed-policy control values using trajectory-level keyword-hit, token-rank, and KL signals. Experiments with Qwen3-8B on three GEM-Bench scenarios report improvements in LLM-judged response and advertising metrics and lower total token consumption than rewriting pipelines.
Critical strengths
-
The method offers a concrete, modular way to control keyword realization during generation. The trie tracks partial keyword matches, the FSM avoids immediately committing to ambiguous root tokens, and the controller adjusts steering strength and duration. This design can operate with a frozen backbone and accommodates a changing keyword inventory without updating the backbone weights.
-
The experiments cover distinct application scenarios and examine the cost of rewriting. The category-granularity sweep shows that a single general head, a small category bank, and fine-grained specialization can behave differently across dialogue and commercial search. Comparisons with insertion and rewriting pipelines also quantify an operationally relevant difference in token consumption.
Critical weaknesses
-
The contribution of the learned adaptive controller is not adequately isolated. The main baselines rely on different advertising pipelines, while the primary ablation only varies category granularity. The paper lacks controlled comparisons using the same retrieval and trie infrastructure with tuned fixed biases and decay rates, an FSM-only controller, or independently learned strength and decay parameters. Furthermore, all steps within a rollout are assigned targets derived from the same trajectory-level outcome, despite the rollout being generated under fixed control values. This provides no direct evidence that increasing either control parameter at a particular context would improve the outcome.
-
The evaluation does not substantiate the claimed improvements in user experience or the absence of an advertising–quality trade-off. Trust, Notice, and Click are estimated by a single LLM judge rather than measured through actual user behavior. In particular, the Trust rubric rewards the absence of perceived external motives, despite the sponsored nature of the placements, and the paper does not evaluate the impact of explicit sponsorship disclosure. The evaluation also lacks an unsteered, ad-free reference to quantify potential degradation in answer quality, reports no uncertainty estimates, and does not specify a held-out selection protocol for choosing the best category granularity for each scenario. Finally, while token counts provide a useful measure of token consumption, they are insufficient to support claims about end-to-end latency without accounting for query-anchor generation and retrieval overhead.
Questions for authors
-
Does adaptive learning outperform a matched fixed controller? With retrieval, selected ads, backbone, prompts, and decoding settings held fixed, please compare tuned fixed strength/decay, the FSM without a learned head, and the learned controller, including separate strength and decay ablations. How were rollout data split, and are ads or categories used for evaluation held out from training?
-
Do the benefits persist under disclosed sponsorship and a fixed evaluation protocol? Please compare against an ad-free response and the strongest advertising baseline with the same retrieved ads, explicit sponsorship labels, and a granularity chosen on validation data. Can human judgments or an independent judge with uncertainty estimates validate the claims about trust and engagement, and can end-to-end timing substantiate the efficiency claim?