- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper considers the following problem: For a question, generate a pool of answers and then based on user's preference sample an answer from the pool that aligns with user's preference. The goal is to construct a sampling distribution that optimize an objective function which is a sum of user's preference score and the KL divergence of with the original sampling distribution(without taking user's preference into account) The contribution is an algorithm called POOLALIGN, whose objective function value is close to the ideal optimum with high probability. The authors also proved some theoretical results that characterize the difficulties of the problem.
Critical strengths
The strength is a good theoretical guarantee of the algorithm and a precise characterization of the hardness of the problem.
Critical weaknesses
My biggest concern is about the motivation of the problem.
- The paper does not clearly identify cases in which questions are known in advance, while user preferences become available only after the candidate response pool has been generated.
- The paper does not demonstrate that a shared response pool reduces total cost compared with generating responses after the user's preference is known,
Questions for authors
Please see weakness.