- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper defines LLM paternalism as a phenomenon in which personalized LLMs restrict users' options based on their profiles or insert unsolicited content into their responses. To measure this phenomenon, this paper proposes DivScore and DriftScore. Through PaterBench, which consists of 2,000 real Reddit user scenarios, it demonstrates that such behaviors are widespread across existing LLMs and that these phenomena can be detected through the hidden states and attention of LLMs, respectively. Furthermore, this paper also proposes a method that mitigates LLM paternalism without additional training while maintaining response quality.
Critical strengths
- Concrete metrics and benchmark for addressing the identified problem: To address the paternalism problem raised in this paper, this work (1) proposes metrics and a benchmark to measure paternalism, (2) conducts analyses of existing LLMs, and (3) proposes a method based on these analyses. All three components are clear and well connected, improving the overall quality of this paper. Specifically:
- Regarding the proposed metrics, the experiments demonstrate that the proposed approach is not only more efficient than simple LLM-based evaluation but also provides a more effective evaluation framework.
- The analysis experiments and proposed method are clear and effectively provide useful insights not only into paternalism but also into how LLM personalization works in general.
- Personally, I believe these insights could serve as an important milestone for future advances in LLM personalization.
Critical weaknesses
Personally, I could not identify any major weaknesses in the analyses or proposed method for addressing paternalism. However, I have the following concern regarding how the problem of paternalism is framed in this paper. I would be willing to increase my rating if this concern could be resolved or at least alleviated through discussion.
- Concern about whether paternalism should be considered together with users' fine-grained preferences: I believe that "restrictive paternalism" and "active paternalism," which are introduced as problems in the Introduction, are essentially about "what information an LLM provides to users and how it delivers that information." In other words, for these behaviors to be considered problematic as excessive intervention beyond "well-calibrated personalization," I believe they should be considered problematic when the LLM performs them despite the user not wanting such behaviors.
-
For example, considering Figure 1, some users may actually prefer to receive only the information they truly need, selectively and quickly, with the main point presented first. In such cases, the response at the bottom of Figure 1 could actually be a more "well-calibrated personalized" response for those users.
- Conversely, if a user with such preferences were given the response at the top of Figure 1, it might actually be less "well-calibrated" to their preferences, which could be considered a failure of LLM personalization itself.
-
In this context, I believe that to measure paternalism as a problem beyond "well-calibrated personalization," the evaluation should be controlled to measure only cases where the LLM performs such behaviors despite the user having preferences against them. I also wonder whether the analyses should have been conducted specifically on such cases.
- Otherwise, the analysis results may mix cases where the LLM is actually performing personalization well (i.e., users who prefer more intervention) with cases of unwanted paternalism. This raises the concern that the analysis may not fully reflect paternalism itself.
-
Questions for authors
Could you share your thoughts on the weakness discussed above, along with supporting evidence or any additional analysis results?