- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes R2Rec, a reasoning-enhanced LLM recommendation framework that leverage collaborative information from user-item interaction graphs. The method first samples interaction chains from the graph and transforms them into structured Interaction-of-Thought reasoning traces. These traces are than used for supervised fine-tuning, followed by reinforcement learning with reasoning-length and ranking-correctness rewards.
Critical strengths
- the paper is motivated, and easy to follow.
Critical weaknesses
- The proposed framework largely combines established techniques, including user-item graph, CoT prompting, SFT on generated reasoning trace, and GRPO. Similar ideas have been explored in existing graph + reasoning-enhanced recommendation methods. The paper should distinguish its core contribution from prior work.
- The latest baselines in the paper are from 2025; the authors should include more recent SOTA methods, as this is a fast-moving domain.
Questions for authors
what fundamentally distinguishes interaction-of-thought from existing approaches? and which LLM is used to generate the Interaction-of-Thought reasoning traces?
7 comments
Response to Reviewer WthK - Part 2/2
W2: Comparison with more recent recommendation-reasoning methods
To align the added baselines with the research question of R2Rec, we prioritize recent methods that directly study LLM reasoning for recommendation.
Specifically, we include VRec(2026.03) [3] and IRMD(2026.07) [4]. VRec studies verification of recommendation reasoning, i.e., how to improve the reliability of the reasoning process, while IRMD studies how to convert explicit reasoning into more efficient implicit reasoning through multi-teacher distillation. They represent recent directions in Reasoning for Recommendation on reasoning verification and reasoning internalization/efficiency, respectively.
R2Rec addresses a complementary question: how reasoning supervision itself can be derived from recommendation interactions and grounded in collaborative evidence.
Accordingly, this comparison does not select baselines according to a particular optimizer, but instead compares different reasoning mechanisms within the same Reasoning-for-Recommendation research context.
| Method / Setting | MovieLens HR@1 / HR@3 / NDCG@3 | Amazon Book HR@1 / HR@3 / NDCG@3 | Amazon Electronics HR@1 / HR@3 / NDCG@3 |
|---|---|---|---|
| VRec | 0.386 / 0.518 / 0.462 | 0.564 / 0.625 / 0.596 | 0.427 / 0.579 / 0.519 |
| IRMD | 0.392 / 0.523 / 0.471 | 0.568 / 0.642 / 0.608 | 0.430 / 0.567 / 0.517 |
| R2Rec | 0.411 / 0.549 / 0.493 | 0.591 / 0.664 / 0.632 | 0.467 / 0.602 / 0.545 |
After adding these more recent recommendation-reasoning methods, R2Rec remains stronger across all metrics on all three datasets.
These results show that directly constructing evidence-grounded, step-wise reasoning supervision from high-order collaborative interactions provides a stable and effective recommendation-reasoning signal.
Q2: Which LLM generates the Interaction-of-Thought reasoning traces?
R2Rec uses DeepSeek-R1-Distill-Llama-8B as the downstream recommendation model, while the original Interaction-of-Thought traces are generated by GPT-4o.
We further use the stronger GPT6.1-sol model as the reasoning-trace generator while keeping the downstream recommendation model and subsequent training procedure unchanged.
| Trace Generator | MovieLens HR@1 / HR@3 / NDCG@3 | Amazon Book HR@1 / HR@3 / NDCG@3 | Amazon Electronics HR@1 / HR@3 / NDCG@3 |
|---|---|---|---|
| GPT-4o | 0.411 / 0.549 / 0.493 | 0.591 / 0.664 / 0.632 | 0.467 / 0.602 / 0.545 |
| GPT6.1-sol | 0.438 / 0.578 / 0.520 | 0.611 / 0.683 / 0.653 | 0.485 / 0.620 / 0.563 |
Using the stronger generator further improves downstream recommendation performance on all three datasets. This shows that higher-quality synthesized reasoning traces can provide stronger reasoning supervision and directly improve the recommendation-reasoning capability learned by the downstream model.
References
[1] Recllm-r1: A two-stage training paradigm with reinforcement learning and chain-of-thought v1.
[2] ReRec: Reasoning-Augmented LLM-based Recommendation Assistant via Reinforcement Fine-tuning. ACL'26.
[3] Verifiable Reasoning for LLM-based Generative Recommendation. SIGIR'26.
[4] Think, But Don't Tell: Implicit Reasoning for LLM-based Sequential Recommendation via Multi-Teacher Distillation. SIGIR'26.
Thank author for the clarification and additional experiments. However, my novelty concerns remains. Graph-based collaborative reasoning, answer-guided reasoning generation are established techniques and progressive marking from A.1 appears to be a prompting strategy. I appreciate the authors' efforts and will increase my score to 2.
Response to Reviewer WthK - Part 1/2
Thank you for your attention to the core contribution of Interaction-of-Thought, comparisons with more recent methods, and the reasoning-trace generator. Below, we clarify the methodological distinction of R2Rec and provide additional experimental evidence.
W1 & Q1: What fundamentally distinguishes Interaction-of-Thought from existing graph + reasoning approaches?
The core methodological contribution of R2Rec is a collaborative-structure-to-reasoning-supervision process that transforms implicit collaborative relations in the recommendation graph into factual, learnable, step-wise preference reasoning.
This differs from recent methods such as RecLLM-R1 [1] and ReRec [2] in technical focus. RecLLM-R1 mainly studies how reasoning and reinforcement-learning-based post-training can improve LLM recommendation, while ReRec focuses on improving reinforcement fine-tuning for complex recommendation reasoning. R2Rec instead addresses an upstream problem: how to ground the model's reasoning itself in verifiable collaborative evidence from recommendation data before subsequent optimization.
Interaction-of-Thought defines three complementary mechanisms.
First, closed interaction chains define where the reasoning evidence comes from. They extract multi-hop collaborative relations from the user-item graph and turn implicit graph connectivity into explicit, traceable behavioral evidence.
Second, progressive masking keeps intermediate reasoning grounded in evidence. At each step, the model can only use the interaction information revealed up to that point. The resulting reasoning path is therefore built progressively on factual collaborative interactions rather than generated as unconstrained free-form CoT.
Third, outcome-level guidance keeps the final conclusion consistent with observed user behavior. Consequently, Interaction-of-Thought combines intermediate evidence grounding with final outcome consistency.
We therefore define Interaction-of-Thought as:
a mechanism that transforms collaborative interaction structure into evidence-grounded, step-wise reasoning supervision while keeping the final conclusion consistent with observed user behavior.
The key distinction is not simply the textual form of the reasoning trace, but that each reasoning step has explicit factual interaction evidence as its basis.
The resulting IoT traces are subsequently internalized through supervised learning and further refined with recommendation-specific rewards. In other words, SFT and GRPO determine how the constructed reasoning supervision is learned and further optimized, whereas Interaction-of-Thought determines what recommendation evidence the model should reason over and where the supervision comes from.
We further validate these mechanisms through matched controls:
Answer-only supervision removes the synthesized intermediate reasoning traces and learns only the final answer; Shuffled Interaction Chains disrupt the original collaborative structure; Unstructured Interactions preserve the interaction information but remove the structured chain organization.
R2Rec consistently outperforms all three controls. In particular, performance drops when collaborative relations are disrupted or structured evidence is replaced with unstructured interactions even when the interaction content is preserved.
These results support our central positioning: R2Rec improves recommendation by grounding reasoning in factual collaborative interaction evidence and converting user-item structure into effective recommendation reasoning supervision.