- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FlexRec, a reinforcement learning post-training framework for adapting LLM-based recommenders to different recommendation needs. It studies closed-set autoregressive reranking, where the model generates a permutation of candidate items conditioned on user context and a need-specific instruction.
The method introduces two main components. First, a swap-based item-level reward estimates the contribution of individual ranking decisions by comparing each placement against counterfactual swaps with subsequent positions. Second, an uncertainty-aware GRPO mechanism employs a critic to estimate interaction rewards and predictive variances, using the latter to down-weight potentially unreliable policy updates.
The authors construct three recommendation objectives, namely Maximizing Interest, Explore New Topics, and Trend Promotion, on KuaiRec and MovieLens-1M. They additionally evaluate product search on ESCI. Experimental results show substantial improvements over several traditional and LLM-based ranking baselines, particularly for interest maximization.
Critical strengths
1. A relevant problem with a clearly motivated training framework.
Adapting a recommender to different objectives without maintaining separately optimized ranking models is an important research direction. The proposed framework addresses two meaningful challenges in LLM-based ranking: fine-grained credit assignment and unreliable reward supervision under sparse interactions. The method is coherent and provides a concrete way to incorporate both factors into GRPO-based training.
2. Encouraging ranking performance and useful ablation studies.
The results on the interest-maximization task are substantial. For example, FlexRec achieves NDCG@5 values of 0.597 on KuaiRec and 0.615 on MovieLens-1M, outperforming the strongest alternative post-trained baseline in Table 1. The paper also evaluates established and recent ranking methods, provides results on a third dataset, and examines reward normalization and uncertainty weighting. These results suggest that the proposed training recipe can be effective.
Critical weaknesses
1. The evaluation for flexible, need-conditioned recommendation could be further strengthened.
The central claim concerns adaptation to varying recommendation needs, but the new-topic and trending objectives are constructed using deterministic combinations of existing semantic, categorical, and popularity signals. In particular, the new-topic objective applies a multiplicative bonus to embedding-based relevance, while the trending objective combines normalized semantic similarity and popularity with fixed weights.
Although these constructions provide controlled evaluation targets, it is unclear how well they represent real, potentially conflicting user or platform objectives.
More importantly, the generalization results are mixed. In Table 6, FlexRec reduces Recall@5 and MRR@5 on KuaiRec Trend Promotion relative to the base LLM. The controlled introduction-switch experiment also reports relatively small differences between matching and non-matching instructions for some objectives.
Questions for authors
- Objective construction and practical validity: Why were the fixed coefficients for niche discovery and trend promotion selected? How sensitive are the results to these choices, and can the authors evaluate the method on more realistic or independently annotated need-specific objectives?
- Simple need-aware baselines: Since the constructed objectives depend on semantic similarity, item categories, and recent popularity, how would a deterministic objective-aware reranker, or a lightweight learning-to-rank model using the same information, perform?
- Reward ablation: Can the authors provide a factorial ablation separating future-only versus prefix-agnostic swaps from pooled versus rank-wise normalization? How much of the improvement is attributable to each design choice?
Rebuttal for Reviewer MpB8
Q1. Objective construction and practical validity
Our construction follows the intuition that users can have several needs at once. A user may want to discover unfamiliar topics or follow current trends while still receiving relevant recommendations. Combining relevance with novelty or popularity gives us an objective that captures these preferences together.
X Trends uses a 60/40 split between similarity to the user’s interests and the trend score in its light-ranking stage [1]. Pandora’s Discovery mode lets listeners keep the same station while hearing more artists who rarely play there [2]. Our objectives capture these two product choices. For Trend Promotion, we likewise give relevance more weight than recent popularity (70/30). For Explore New Topics, we boost an item’s relevance score by 50% when its topic is absent from the user’s history, so a relevant but unfamiliar item can rise in the ranking. Therefore, we believe the multi-need label construction is realistic.
[1] X. Trends Recommendations. X Help Center.
[2] Pandora. Pandora: Personalized Music App. App Store, “Pandora Modes.”
Q2. Simple need-aware baselines
We already report two relevant baselines. STAR ranks candidates deterministically by cosine similarity to the user’s recent history (Appendix D, lines 835–842). BERT4Rec is a learned sequential ranker trained on interaction sequences (lines 320–322). Both are compared with FlexRec in Tables 1, 2, and 6, and STAR is also evaluated on ESCI in Table 9. The semantic retriever and the LLM rerankers receive the same item metadata (Appendix E, lines 853–854).
Q3. Reward ablation
The completed factorial comparison is shown below. Values are NDCG@5 on dense KuaiRec under GRPO.
With pooled normalization, future-only swaps improve NDCG@5 by 0.146. With rank-wise normalization, prefix-agnostic swaps score 0.032 higher. Pooled normalization improves future-only swaps by 0.147, while rank-wise normalization improves prefix-agnostic swaps by 0.031.
We hope these clarifications and the additional ablation address your concerns. In light of this evidence, we would appreciate your considering an upward revision of your rating.