- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents RIVET, a framework for evaluating retrieval-induced value steering in search-augmented LLMs. It examines two attack settings, query rewriting and evidence selection, which manipulate retrieved evidence without modifying its content. Experiments on ValueActionLens and ValueBench using five LLMs demonstrate that such manipulation can influence value judgments. The authors also propose M-RIVET, a retrieval-stage defense that detects stance imbalances and repairs retrieved evidence to mitigate these effects.
Critical strengths
-
Relevant research problem. The paper investigates how the selection of authentic retrieved evidence can influence LLMs' value judgments. This is a different security concern from traditional document poisoning.
-
Mitigation mechanism. The paper proposes a retrieval-stage defense that detects stance imbalances and selectively repairs evidence. The results show it can reduce value steering under the evaluated attack settings.
Critical weaknesses
-
Limited practicality of the threat model.
(1) The M2 attack adds directional terms such as "support" or "oppose" to the original search query, changing its semantic meaning and the information being requested. Consequently, retrieving different evidence is an expected behavior of the search engine, instead of being affected by adversarial manipulation.
(2) M3 assumes that attackers can directly select which evidence is presented to the LLM. While these attack settings are theoretically feasible, the paper does not demonstrate how attackers could obtain such control or execute these attacks in real-world search-augmented LLM systems.
-
Lack of evaluation on real-world search-augmented systems. The experiments rely on a simplified pipeline constructed by authors that retrieves Google Search snippets through the Serper API and feeds them to LLMs. However, the paper does not evaluate real-world end-to-end search-augmented systems, such as Perplexity AI or GPT-4o-search-preview. It does not examine how its experimental setup differs from these systems yet.
-
Insufficient attack and defense comparisons. The attack evaluation is limited to the authors' proposed M2 and M3 settings, without comparisons with existing query or retrieval manipulation attacks. On the defense side, M-RIVET is mainly compared with MMR and xQuAD, while simpler alternatives, such as restoring neutral retrieval results, are not adequately evaluated.
-
Unclear presentation. The paper's presentation makes it difficult to follow:
(1) The excessive use of bullet points and bolded opening phrases makes the writing fragmented and disrupts the logical flow.
(2) The distinction between evaluation baselines (M0/M1), attack settings (M2/M3), and additional experimental controls is not clearly organized.
(3) The numerous labeling procedures and their roles in the overall framework are difficult to follow.
(4) The rationale behind several thresholds and repair rules is insufficiently explained.
(5) The framework figures contain excessive text, complicated flowcharts, and substantial unused space, making the core methodology difficult to understand.
-
Ambiguous interpretation of attack success. The paper measures value steering primarily through deviations from responses under neutral retrieval. However, in M2, adding directional terms such as "support" or "oppose" changes the search query's meaning, and the resulting responses are naturally expected to reflect the modified retrieval intent. Therefore, deviations from the neutral-query response do not necessarily indicate a successful attack. Similarly, restoring the original response does not necessarily demonstrate improved correctness or safety.
Questions for authors
The main questions have been outlined in the Weaknesses section.