- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This research investigates the frequency with a LLM providing the same response after the context referenced in the LLM's explanation has been removed. It was found that most of the answers were preserved after removing the context from the question-answering data sets. However, even though many of the answers were preserved, there was only a small improvement when the context was removed and the answers were regenerated.
Critical strengths
This study analyzed approximately 53,000 citations from both instruction following models and reasoning models. There were also evaluations using closed models and synthetic data.
Critical weaknesses
1)The main issue is that the authors have over-interpreted their metric as evidence of unfaithful rationalization. Answer preservation after deletion is a measure of dispensability; it does not indicate whether the original computation ignored the cited evidence.
2)The causal decomposition used by the authors is not justified. Answers provided correctly without context do not demonstrate that context was not used in the first place. The "prior knowledge" criterion used by the authors can also classify examples where the original answer was different or incorrect. The authors' metric also fails to capture substantive evidence use. Evidence may affect confidence levels or answer probabilities without affecting which answer is chosen.
3)The authors do not evaluate their proposed content replacement criterion. The permissive answer matching used by the authors may inflate the results. Subsets and supersets are classified as "SAME", which means that the loss of material answer content could be counted as evidence of non-use. The statistical guarantees provided by the authors do not account for measurement error. Since unvalidated LLM judges and context rewrites are used to generate the data, the confidence bounds cannot be relied upon to accurately detect actual rationale unfaithfulness.
4)The mitigation experiment conducted by the authors does not support their conclusion. Approximately 18-22% of relevant HotpotQA cases result in changed answers when joint stripping is applied. Therefore, failure of this single procedure does not demonstrate that inference-time mitigation is inadequate.
Questions for authors
How is a citation that has never been cited in the first place distinguished from a citation that was once cited but then replaced by a different path of reasoning after it was deleted?
How can you demonstrate that the original response did not use the context based on correctness alone (i.e., without considering the context)?
How would your findings be affected if you measured influence using answer probability instead of final-answer identity?
Will the reported rates still be comparable if you no longer classify subsets and supersets as equivalent answers?
Does re-decoration continue to occur when joint removals result in preserving the original answer, and what evidence supports extending this situation beyond the single mitigation studied?