- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper explores a strategy for quantifying uncertainty in a model's QA extractive QA response using prompt perturbations. The authors argue that current perturbation-based UQ algorithms appear to rely on unsophisticated strategies for generating perturbations (new prompts). The key contribution is the use of an evolutionary search-based strategy to generate diverse prompts. For that, they hand-design a space of 12 different “types” of perturbations (based on a 3x4 combination of the type of prompt rewrite and how explicitly the answer is supported in the rewrite). The authors then use a search strategy called MAP-Elites to fill this 12D space, retaining high-quality prompts based on a fitness function defined by semantic closeness from x, surface edit magnitude from x, and fluency. At the end, the different retained prompts are used to generate answers, and the semantic entropy over their induced answer distribution is taken as the uncertainty score. Results show better discriminative performance across extractive QA datasets and models than Semantic Entropy and other self-created QD variants.
Critical strengths
None
Critical weaknesses
Key Weakness 1: Evaluation Issues & Missing Baselines
W11: Methods are evaluated on different samples (see Table 1). As the authors write (L325-326), a method is scored if it has ≥ 2 predictions “where semantic entropy is defined”. Semantic Entropy is also defined at 1 prediction, namely SE=0. I do not see any reason to exclude these cases.
W12: Compute Costs are not transparent / very high: The method has the following steps, as I understand them, to create 1 potential candidate: Editor (Creating a new prompt based on the parent), Feasibility (three gates) + Search Objective Evaluation. As we run this (many?) times - I can’t find a number for how often this is run exactly- this seems very costly. In this spirit, comparing Semantic Entropy with only as many samples as the archive holds in the end (L278/288) is probably a very unfair comparison in terms of compute budget. A similar concern here is that while SE can reuse the cached prompt and only needs to sample new generations, the proposed method must create a new prompt (which is costly if the answer is short relative to the prompt).
W13: Missing Baselines: The authors themselves position the paper as pertubation based UQ (which is clearly correct) yet do not evaluate similar works e.g. SPUQ [1]. Similarly, many other UQ baselines are easily accessible with e.g. LM-Polygraph [2]
W14: The editor (proposing a new prompt) gets the gold answer, as it should be preserved across rewrites (L199—201). At inference time, the gold answer is not available, as if I had it, I would not need to solve the task.
Consequence of assessment: In its current form, the results are not trustworthy, and as such I can not conclude an advantage of the method.
Key Weakness 2: Very Hard to Read Manuscript
W21: The paper is poorly written at many parts:
- In general, it has heavy tail-tale signs of pure AI-generated text (Many small paragraphs, technical terms used before being introduced, result section mainly stating numbers of tables and figures instead of setting them in context).
- The introduction e.g., first starts with a related work section of UQ, not even focusing on perturbation-based UQ (starts in paragraph 4)
- At times, it uses terms not yet introduced (e.g., L60 QD algorithms; (I don’t think these are generally widely known). L082: descriptor space, L088: one cell, L093/94 two axes: four levels of answer support. L156: MAP-Elites (Again, I don’t think MAP-Elite is a term everyone knows except those who worked with QD algorithms).
- L129 Vicinal risk minimization does not seem really related to this problem. Rather, some background on evolutionary methods and MAP-Elites would be helpful.
Consequence of assessment: It is hard to follow the paper even though the actual content is quite simple and could be well presented and as such does not meet standard of an A* publication.
References:
Questions for authors
Q1 - Improve Experiments
- (See W11) Please provide the evaluation on an equal amount of samples and clarify why omitting SE=0 samples should be valid.
- (See W12) Please provide (1) What are the costs (e.g., how many LLM calls vs. deterministic rules) to create 1 candidate? (2) How long does this strategy run on average, and what is the total cost in the end? (3) If it is significantly higher than the number of calls used to approximate SE, please run a baseline with compute-adjusted SE.
- (See W13) Please include especially other perturbation-related baselines (SPUQ).
- (See W14) Please clarify the use of the gold answer and explain how the method would work if you did not have access to it.
Positive results and clarification on these issues could slightly affect my assessment
Q2 - Better Manuscript
In my opinion, the manuscript needs a significant rewrite, which is not possible in the rebuttal period. As such, this caps my potential change of assessment of Q1 at (2-Weak Reject).