- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper frames the problem of online personalization as a contextual dueling bandit problem. The authors propose a a method that learns a gaussian mixture prior from previous users and then use bayesian logistic regression to fit new users.
Critical strengths
- The online llm personalization is an important problem. The author created a good abstraction that allows them to establish sound mathematical models behind it
Critical weaknesses
- Personalization settings are way too toy. The paper only has 6 persona, and the reward model is a linear utility model. I found this setting to be too vanilla to be representitive as realistic personalization setting.
- There is little novelty in personalization algorithm design. It seems that the author simply moved gaussian mixture priors and bayesian logistic regression into the field of llm personalization, where the setting itself is already highly simplified.
- The authors assume that user preference vary across questions, but from the experiments it's unclear whether the model directly learned the user's preferred persona than being question conditioned.
Questions for authors
See weakness