- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
RRCM is a method for dynamically retrieving Collaborative Memory and Metadata Memory in LLM-based recommendation systems and training a retrieval policy optimized for final recommendation performance using GRPO. It demonstrated consistent performance improvements over existing methods across three datasets.
Critical strengths
Consistent Performance Improvements: It outperforms various recommendation baselines, and the effectiveness of each component was verified through ablation studies.
Effective Information Integration: It improves recommendation quality by selectively leveraging collaborative signals and item metadata.
Thorough Experimental Analysis: It provides a wide range of additional experiments covering retrieval behavior, long-tail performance, robustness, and computational cost.
Critical weaknesses
Limited Novelty: It is methodologically similar to existing RL-based adaptive retrieval methods such as Search-R1[1], and its originality beyond the extension to the recommendation domain is unclear.
Lack of Validation of Key Contributions: Without a strong static retrieval baseline using the same memory and computational budget, it is difficult to isolate the effectiveness of the adaptive policy itself.
Issues with Comparison Fairness: While RRCM accesses a large-scale external collaborative memory, some baselines cannot utilize the same information, which may lead to a conflation of the effects of additional information and methodological improvements.
[1] JIN, Bowen, et al. Search-r1: Training llms to reason and leverage search engines with reinforcement learning. arXiv preprint arXiv:2503.09516, 2025.
Questions for authors
How does RRCM fundamentally differ from existing RL-based adaptive retrieval frameworks such as Search-R1, beyond applying them to recommendation with heterogeneous memories?
Can the authors provide comparisons with stronger static or fixed-budget retrieval baselines using the same memory corpus, backbone, and training objective to isolate the contribution of the learned retrieval policy?
Given that RRCM accesses a substantially larger collaborative memory corpus than the training data available to some baselines, how can the authors distinguish improvements from additional information access versus the proposed methodology?
4 comments
W3/Q3. Baseline Comparison
We wish to highlight that we've already discussed this issue in detail in Appendix F.2. A central motivation of RRCM is that existing LLM recommenders struggle to incorporate extensive histories and rich metadata within limited context and computational budgets, often relying on signals encoded through training or fixed retrieval strategies. Simply appending the external memory to non-retrieval baselines would change their intended designs without resolving these constraints and can be impractical in many real-world settings. As such, adaptive access to external evidence is itself a methodological capability being evaluated. To distinguish its benefits from those of additional information alone, our evaluation already includes methods that retrieve and incorporate external evidence through their intended mechanisms, alongside controlled retrieval-policy comparisons.
Specifically, K-RagRec retrieves item information from a knowledge graph, while BinLLM and CoLLM incorporate collaborative signals through learned representations trained on exactly the same interaction records as RRCM’s collaborative memory. Thus, these comparisons assess different ways of representing and incorporating collaborative information with the same underlying data access. In contrast, RRCM learns when and what evidence to retrieve, allowing context construction to adapt to each recommendation instance.
Furthermore, the All-Evidence and Fixed-Retrieval experiments in Appendix D.2 directly control for access to both memory sources, using the same corpus, retriever, backbone, and ranking-based training objective. RRCM’s improvements over these controls support the effectiveness of its adaptive retrieval policy beyond the benefit of additional information. The ablations in Section 4.3 complement these comparisons by examining the contributions of collaborative memory, metadata memory, and reasoning. Together, these experiments distinguish the value of the evidence sources from the value of learning how to acquire and use them. We've further clarified the baseline data access and expanded this discussion in the revised paper, marked in red.
Dear Reviewer Xeas,
Thank you again for the time and care you have devoted to evaluating our paper and for your thoughtful comments. As the author–reviewer discussion period approaches its deadline, we would like to confirm that we have adequately addressed your remaining concerns.
In response to your feedback, we have clarified our methodological novelty and empirical positioning relative to general RL-based retrieval frameworks like Search-R1, added a controlled Fixed-Retrieval baseline using the exact same memory corpus and optimization setup to isolate the value of adaptive retrieval, and explicitly detailed how our collaborative-memory baselines and ablations ensure fair comparisons across data access.
Please let us know if any questions or concerns remain. We greatly value your feedback and would be glad to provide further clarification at any time.
Best regards,
The Authors
Dear Reviewer Xeas,
With one day remaining in the author–reviewer discussion period, we wanted to follow up briefly. We would appreciate any feedback you may have on our responses and revisions.
If any questions or concerns remain, we would be happy to address them anytime. If you feel that our revisions have addressed most of the concerns, we would be grateful if you would consider raising the score.
Thank you again for your time and thoughtful feedback!
Best regards,
The Authors
Dear Reviewer 7ks9,
Thank you for your positive assessment of our information integration design, performance improvements, and thorough experimental analysis. We appreciate your constructive comments and the opportunity to clarify our experimental comparisons and methodological contribution.
W1/Q1. Methodological Novelty
Thank you for raising this point. We would like to clarify that our contribution is an application-driven methodology addressing an important challenge in LLM-based recommendation: selectively incorporating heterogeneous evidence under context-length and computational constraints. Practical recommender systems often contain thousands of item features and extensive interaction histories. Determining which evidence is useful for a particular recommendation, and how to fit it into a limited LLM context, remains an important unresolved problem. As the ICLR reviewer guidelines state, "Submissions bring value to the ICLR community when they convincingly demonstrate new, relevant, impactful knowledge (incl., empirical, theoretical, for practitioners, etc)." We hope this clarifies our emphasis on methodological and empirical contributions to this application problem.
Our central insight is to make evidence acquisition a learnable part of the recommendation policy, guided by final ranking quality. Although similar components appear in retrieval-and-reasoning frameworks such as Search-R1, RRCM uses one interface for collaborative histories and item metadata and learns when and what to retrieve jointly with recommendation through end-to-end RL. In contrast, previous method K-RagRec uses a predefined strategy for metadata retrieval, while BinLLM and CoLLM incorporate collaborative information through learned embeddings. RRCM's significant performance gains over these methods demonstrate the value of adaptive evidence acquisition in this setting. The All-Evidence and Fixed-Retrieval controls in Appendix D.2 further show that these gains persist when access to both memories is held constant, with RRCM also using fewer inference tokens. We have revised the Introduction to clarify this contribution and its practical significance.
W2/Q2. Comparison with Retrieval Baselines
Thank you for this suggestion. We would first like to highlight that our evaluation already includes closely related approaches developed to retrieve and incorporate external evidence into LLM-based recommendation. K-RagRec retrieves item information from a knowledge graph, while BinLLM and CoLLM incorporate collaborative signals through learned representations. Moreover, the All-Evidence ablation in Appendix D.2 compares adaptive acquisition with fixed evidence provision using the same memories, retriever, backbone, reasoning format, and GRPO training.
To further isolate the contribution of the retrieval policy, we have additionally trained a Fixed-Retrieval model on Goodreads. We explicitly instruct the model to issue exactly one collaborative-memory query and one metadata-memory query before recommending, and adapt the format reward to penalize violations. The memories, retriever, backbone, reasoning format, ranking reward, and remaining GRPO settings are identical to those of RRCM. This comparison holds the evidence sources and training framework constant while replacing adaptive retrieval with a fixed query budget.
RRCM outperforms Fixed-Retrieval across all four metrics while using 30.3% fewer inference tokens. These results show that its gains persist against a model with the same evidence access and a higher inference cost. Together with All-Evidence, this comparison strengthens the evidence that learning selective retrieval improves both recommendation quality and efficiency. We have added these results and discussion to Appendix D.2.
Furthermore, we've added a control that trains a traditional sequential recommendation model, SASRec, on all available historical interactions, including those populating the collaborative memory. We compare it with RRCM trained with the same training set size in Table 13 (around 12,000). As shown below, RRCM still outperforms it across all four metrics. Thus, the performance advantage persists when SASRec is allowed to train on the interaction records available through RRCM’s memory. RRCM uses substantially fewer interactions for parameter updates while accessing the remaining behavioral evidence through retrieval. We have included these results in the revised Appendix D.1.