- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces REC, a method to assign an uncertainty score to answers of LLMs. It tries to create different uncertainty signals, by (0) creating an anchor scenario if not available (1) extracting supporting evidence for a QA pair in the context (2) rewriting into an equivalent context and a counterfactual context (3) deriving some score from answer agreement and evidence support with subsequent aggregation schemes. However, deriving the score hinges on a large and possibly very capable model (much more than the models used to actually answer), while other parts of the pipeline use small and even a task specific model. The method was evaluated on a fairly standard setting (the two main eval strategies, four tasks, four models) and did some ablation on the method's components.
Critical strengths
None
Critical weaknesses
- The whole pipeline is extremely complex. It relies on multiple models (General LLMs, but also specialized ones like the NER one) and particular prompt templates for different LLMs involved in different roles in the whole pipeline. Also, it assumes some kind of knowledge about the task format, evidenced by the different prompt templates for different tasks. While the method seems to work very well on the selected benchmarks, it appears to be overengineered to those and is likely not applicable to other tasks, see my question below.
- The whole introduction of different parts of the method are a bit ad-hoc and heuristic. There is no reasoning behind the different types of aggregations, analyses on the quality of LLMs to achieve intermediate steps or the support scoring.
- The actual score used within the remaining machinery of REC is s_i, a numerical prediction made by DeepSeek-V4-Flash - a very capable and big model (nearly 300B). My guess is that the method hinges completely on that fact and the deepseek model might be a very good judge on its own of whether or not the smaller model's answer is gonna be correct or not.
Questions for authors
- In the weaknesses I identified that the method seems very engineered towards the particular benchmarks targeted. If you could provide good results for the SVAMP dataset (math questions which is a bit OOD for the method as presented) without changing prompts and stuff, that would illustrate if I am right or wrong about that, even if you just compare against simple baselines such as P(True) or SAR.
- Did you investigate how well rewriting with the SLM works in practice? Dependent on the types of context it could be very hard to preserve all important information. Also, without the question it is also not clear what information is important? What if the question is "What word in the context features most vowels?". Obviously that is a worst case scenario and mostly its fine, but could you elaborate on possible validation steps, e.g. letting the SLM check equivalence between the two, conditioned on the prompt (and possibly anchor answer) in an intermediate step? Going back to the original question, could you provide numbers on the quality of SLM rewrites using the outlined setup?
Remarks
- Please remove that "depth" effect in Figure 1 and 2, I know it should symbolize the multidimensionality, but it just makes it hard to parse.
- Captions for Figure 1 and 2 should explain what we are seing there.
- 'q' is used for two different things and '\eta' is introduced for no good reason I could identify