- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper explores whether appending prompts with text inducing different types and levels of stress can improve their performance in various domains. Inspired by the fact that humans have an "optimal" level of stress, where performance increases with a rise in stress up to a point (before it starts decreasing), the consider four levels of stress applied across six different "types" of stress (that cover challenges, hindrances, and threats). The authors propose a new metric they call the "Behavior Score", which adjusts raw increases in accuracy with a reduction in verbosity and hedging (saying "I'm not sure"). They run a grid search over all 4x6 combinations of stress intensity and type, for every model-task combination (where tasks come from five widely used benchmarks), and identify the "optimal" setting for each, i.e. where the behavior score is highest. In many cases, the accuracy improves (while verbosity and hedging reduce) in with the optimal combination of intensity and stress type. There is no clear trend about what works across LLMs/tasks or for a given LLM/task other that the fact that "challenges" improve performance more than "hindrances" (see below for my objection to this).
Critical strengths
While this paper has some strengths (such as the identification of induced stress as a means to potentially improve LLM performance), I find none of them substantial.
Critical weaknesses
Novelty and significance: The bottom line is that the authors just do a grid-search over the possible configurations and give the combination that works best for a given model for a given task. The results almost seem random, and I don’t learn anything new about LLMs from this. There is no pattern in what stressors or levels bring out the optimal performance. I cannot predict anything about a given LLM (on an unseen task) or a given task (on an unseen LLM) using this. Ultimately this paper just provides a method for prompt engineering (which is not very efficient given lack of generalizability), which also does not necessarily give you the best textual addition (to the original prompt) that would lead to improved performance, due to the limited exploration of the textual space that such an approach can afford.
Soundness: I have concerns about various design choices made by the authors, but two of them are most critical. First, it is not clear to me why "hindrances" (such as giving a model incorrect information) is included as a "stressor". I agree that this would affect the performance (for good reason), but in the case of LLMs (as opposed to humans) it is unclear why this is manifestation of stress. The fact that the performance improvements are greater in the "challenge" (urgency and task-load) case is very obvious, since an LLM given improper guidance as opposed to pressure/urgency is likely to make more errors. The fact that an ideal model which knows the answer should not get distracted by such hindrances is a separate problem (more related to sycophancy than stress). Secondly, I feel the metric is not well motivated. Unless I am mistaken, the papers the authors cite as motivation do not actually support the claim made in lines 271-273. It is not clear to me why less verbosity is desirable. For hedging, the authors do not dissociate cases where abstention is the right answer or a better alternative to the model giving a wrong answer if is unable to solve a problem.
There are various other minor issues such as the use of a separate prompt for different models and tasks in many intensity-stressor type combinations, and the absence of frontier reasoning models (which may not be as susceptible to as prompt-level changes), but those are not as critical as the ones above.
Questions for authors
- Could you elaborate on why less verbosity and hedging are desirable when dissociated from accuracy?
- Can you explain why hindrances (and specifically the ones you provide) are increasing "stress" in an LLM and that the errors being made are due to that stress and not simply due to being misled?
- Apart from s1 and s3, the stressor prompts are adapted for different models or tasks, how do we know to what extent are the results affected by this?
- In line 374, do you mean that your parameter selection involves 400 rounds of cross-validation with the training-validation split being 50-50? Does that mean you have no subset of responses that is purely used as a test set (and not in the parameter selection stage)?
- Beyond the statement "There exists a combination of stress intensity and type [among the possibilities you have considered] that (when translated into a prompt addition) can improve LLMs' performance for a given task", what would you say is the main takeaway from your work?