- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper presents the challenge that current contextual override attacks are tested using different assumptons and experimental setups, which makes it hard to compare the effects or even rank against one another. To solve this problem, the paper presents a unified framework that standardises the documents, facts and corresponding metrics that are robust to challenges facing existing approaches. The paper finds that accumulated corroboration is the most effective attack tested, with all models getting overriden by at least one accumulation.
Critical strengths
- The paper evaluates the proposed unified framework across a wide range of LLMs which improves the validity of the experiments conducted.
- The paper tackles an important problem i.e. the lack of a unified framework to compare the effect of different contextual override attacks.
Critical weaknesses
1. The significance of the contribution remains unclear.
The intro claims that the effect of different attacks remains incomparable because of a lack of a unified framework that allows for comparison. However, it remains unclear what the new finding this unified framework presents that previous work has not already surfaced. There is very little engagement on how the results and findings from the experiments complement or differ from existing work making it hard to determine the utility of the proposed instrument. I would suggest the authors improve the current discussion section by moving beyond just reporting the findings to reflecting on how it answers the problem posed on the lack of a unified framework.
2. Core experimental details are unclear
L248, the paper uses 185 facts to test the instrument proposed, however, it is unclear how this dataset was constructed. Is this sampled from an established dataset or were the facts created for this task? Please provide clearer details on the dataset.
3. The paper omits the Appendix section which makes it hard to cross-check most parts of the paper
The following sections: L116, L160, L381, L502, L503, L504, L505, make references to an Appendix section that is non-existent in this submission. I am unable to cross-check any claims presented in the main sections.
Questions for authors
- Could you provide references for the claims made in L044 - L046, what previous literature supports the claim being made i.e. "The prevailing view, which holds that parametric and contextual evidence each carry an instrinsic strength and the stronger wins...". This claim remains unsubstantiated.
- This framing here needs to be clarified (L041) - "retrieval system does not filter what it surfaces". This sentence may appear misleading as retrieval systems in practice include multiple stages, first-stage retrieval followed by reranking e.g. using a LLM which may filter depending on the requirements of the task. Please clarify what type of retrieval systems you are referring to.
- The notation used in defining the instrument in Section 3.1 is unclear and makes it difficult to follow, I would recommend providing a clear example of a fact, question and document, as well as providing clear definitions of the notation before use.
- How was the size of D selected and did you run any ablations across different document sizes?
- How is this claim substantiated - "allocating more words to deny a claim provides the model with a stronger signal that a denial is occurring"?
- The current presentation format makes it hard to follow through different parts. I would suggest the authors to provide clear section titles that tell the reader where the important parts of the paper e.g. Methodology, Experimental Setup, Results etc.