- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces task of "unbranding" for regulating LLM generated responses.
The paper defined "unbranding" task that for a user request on recommendation from LLMs, the LLMs response should be generic and should not contains any trademarks or brand names, and should not reveals implicit description that reconstructs certain brand or trademark.
Then paper benchmarks existed unlearning algorithms' performance on the "unbranding" task, the main takeaway was existed methods cannot solve "unbranding" task because they demonstrated "brand leakage".
Finally, for solving "unbranding" task, the paper proposes a black-box system prompt optimization framework, named MUTE, and demonstrated that MUTE produces generally better system prompt that makes the LLMs yield less brand or brand-related information in their responses.
Critical strengths
-
The paper is self-contained that it well defines the introduced "unbranding" problem, it has evaluated existing unlearning methods that can potentially solve the target problem, and proposes a solution to the introduced problem.
-
The proposed method is a black-box prompt optimization, which does not require gradient computation through the LLM weight space and it is computationally efficient.
Critical weaknesses
-
The problem significance and task contribution is weak. Particularly, when a user is asking for recommendation for items, why they would not expect a response with a brand/merchandise name, or a purchase source? In other words, reviewer thinks that having a brand name in the LLM response is not problematic.
- A better question is whether model's response is biased to certain brand, or diverse enough to respond with various brands, or the right brand. For example, if the LLM always recommend you a fixed brand "X" no matter what context, this is more problematic. That way, the problem boils down to model and data biases, which has substantial amount of literature already discussed and provides solutions (e.g., racial & gender bias, political bias).
-
The introduced technical solution, MUTE, has nothing novel specific to the "unbranding" problem space. Reviewer think MUTE is an evolutionary prompt search method proposed in [1] and re-apply to the "unbranding" task. The only thing needs adjustment here is data curation that forget and retain data have to be tailored for the "unbranding" task, yet data curation was not a critical component of as what the method delivered in this paper.
-
The comparison in this paper is inappropriate that the proposed method (MUTE) is a system prompt optimization method (prompt or input-space optimization), but it was compared against other types of methods that are unlearning (weight-space optimization). The comparing methods' category is misaligned. For this paper, comparing MUTE against different system prompt search methods here would be more appropriate.
-
The experiment is incomplete.
- The proposed solution is a system prompt optimization, yet the robustness of optimized system prompt in long context, various context location was not tested. For example, does the optimized "unbranding" system prompt is still effective when it is appended to other system prompts that are in various lengths, or when it is injected at various location of the system prompt? This problem is important because the size of system prompt can be large in practical setup.
- Transfer test or more diverse set of models is needed. The generator, judge, and target "unbranding" models are mostly Qwen family models. Even the paper included two other models that are not Qwen's (i.e., LLama, Mistral), it is still worth expanding the model set to more diverse architectures, as model from the same family or provider tend to converge to the similar language space. Or, a transfer test that "does system prompt optimized from one target model works for the other", is worth including.
To summarize,
- The task is relevant to model behavior / output control but in a narrow, brand-related context that reviewer disagree with the problem significance;
- The proposed solution is a black-box system prompt optimization, which follows evolutionary prompt search paradigms.
- The reported experiment is comparing with methods that are not the same method space as the proposed method (i.e., weight-space optimization vs input-space optimization), which makes the evidence of claim less convincing.
- The experiment is incomplete that it lacks of robustness test and transfer test of the optimized system prompt.
Reference
[1] Spurious Prompts: Can Irrelevant Prompts Steer Large Language Models?
Questions for authors
See weaknesses.