- Rating
- 1
- Confidence
- 1(−2)
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies out-of-context hallucinations, where the LM response do not align with the evidence provided in the context. The authors study how the functional role of different token-spans in the prompt influences this behavior. They also contrast this with in-context learning setups, where the LM does reliably follow the prompt accordingly.
Critical strengths
Not assessed yet. See the Critical Weaknesses and Questions For Authors sections
Critical weaknesses
The authors clam in the Abstract and Intro (even in Title) that they are studying out-of-context hallucinations in LMs. In their actual operationalization for most of the experiments, they force in the LM response as , where is the context, is the query. They call the "response", but it is not LLM generated, instead it is forced in the input. So, there is really no way to study know whether the LM's response would have been faithful to the context or not. The authors are not studying hallucinations at all, but rather they are studying how the LM's representation of a forced input changes with different contexts.
Questions for authors
Please see what I flagged in the Critical Weaknesses section above. If my understanding of the operationalization is correct, then it is not even worth it to go over the other technical details of this work, unless the framing is changed significantly. If I find the authors' response to this issue satisfactory, I will be happy to re-read the paper and revise my assessment accordingly.
And, in case there is a fundamental disagreement between the authors and me on how causal analysis on autoregressive LLMs should be conducted, then I will leave it to the discretion of the AC and other reviewers to decide whether this paper is suitable for ICLR or not.
Thanks!