- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper looks at incorrect answers of LLMs and their alternative answer options across three benchmarks (Thruthful-QA, SciFact entailment, BoolQ and ARC-challenge), and uses a "using a fixed weak re-query that provides no gold label, feedback, or additional evidence".
The paper is very difficult to follow, with many key concepts not described well and very unusual structure. Example of difficult passages are immediately in the introduction and abstract: "recovery in the two primary models"- what recovery? why primary?"; "replay-matched audit"?). Also, it is not clear what exactly is traced and how in, e.g., "for each retained failure, we trace gold-versus-realized failure candidate competition during the original response and use a final-window candidate margin as the main pre-query coordinate. Full-response onset, persistence, prevalence, and path-type summaries are retained only as secondary descriptive diagnostics because the evaluated responses are predominantly short.".
There is an experimental flaw in the experiment. The prompt to "re-query" (or, in other terms, to ask the model to self-assess) contains a hint "Your previous answer may be incorrect." while it is run only on failure cases: "For each retained failure (xi , a+i , a−i ) ∈ F , we apply the same weak cautionary re-query Pmin"
The references contain hallucinated paper page numbers and mix up conference names and title. See below.
Critical strengths
Analysing errors in LLMs is in principle an interesting research direction, albeit a challenging one, as it also requires to find insights that generalize across models, to be lasting and impactful results.
Critical weaknesses
see points in my summary above. To summarize:
-
the paper suffers in terms of presentation, has an unusual structure, does not motivate and describe the problem and setup well
-
the re-query prompts with the hint ("Your previous answer may be incorrect.") seems to be confounded, and is misses a baseline. this seems one of the key contributions of the paper. It is unclear to what extent the recovery is sensitive to this particular prompt. The authors acknowledge this limitation and investigate prompt variants, but an important missing baseline is a neutral re-query without any suggestion that the previous answer was incorrect.
-
traces of hallucination in the reference list (made up page numbers), see boldface:
- Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Yu, Xinying Song, and Denny Zhou. Large language models cannot self-correct reasoning yet. In International conference on learning representations, volume 2024,pp. 32808–32824, 2024. (https://openreview.net/forum?id=IkmD3fKBPQ)
Questions for authors
Why did you focus on valid outputs only? (line 097-098)