- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper identifies an important limitation in generative recommendation: while items are represented as discrete tokens, user memory remains implicit. To address this gap, the paper proposes a novel model, DEYI, and its variant, DEYI-phi, which incorporate user history into future-predictive states through either user-specific or user-shared discrete identities. Experimental results demonstrate that the proposed models improve recommendation performance over baseline models using full interaction history, highlighting the potential benefits of explicitly modeling user memory in generative recommendation.
Critical strengths
- The paper is well motivated and addresses an important yet underexplored problem in generative recommendation. Specifically, user memory remains implicit when modeling SID-based interaction sequences, potentially limiting the information available for predicting the target item's SID.
- The paper is well written and easy to understand. The description of the memory components is particularly helpful in clarifying the types of information captured by the memory and how this information contributes to target item prediction.
- The proposed models are evaluated on large-scale datasets, and the results demonstrate improved performance over baseline models using full interaction history, providing empirical evidence for the effectiveness of the proposed memory component.
- Section 4.3, which analyzes the information encoded in the memory, provides useful insights into the internal workings of the proposed approach and helps readers better understand the role of memory in the model.
Critical weaknesses
- Despite the promising empirical results, the proposed methodology remains insufficiently convincing, and the underlying mechanism responsible for the observed improvements requires further investigation. The proposed approach can be interpreted as combining a summary of users' long-term interaction histories with recent interactions, thereby providing additional context through the memorization of long-term user preferences. The results in Table 3 appear to support this interpretation. For products with shorter interaction histories, the full-history baseline and the DEYI variants achieve similar performance, whereas DEYI-phi performs noticeably better, potentially because quantizing user histories introduces user-user collaborative signals through the memory mechanism. For short-video recommendation, the full-history variant substantially outperforms DEYI, possibly because DEYI loses access to long-term historical context. DEYI-phi performs better, potentially because quantized user histories capture collaborative signals similar to those exploited by user-user or item-based collaborative filtering. However, the current experiments do not sufficiently investigate these possible explanations or provide deeper insights into the underlying mechanism. Consequently, it remains unclear whether the observed improvements stem primarily from explicitly modeling user memory, incorporating long-term historical information, or capturing collaborative signals, which weakens the methodological justification.
- The use of memory to improve (generative) recommendation has been extensively studied in prior work [a, b, c, d]. However, the paper lacks an in-depth discussion of these related studies and does not sufficiently clarify how the proposed approach differs from or improves upon existing methods. A more thorough comparison with prior work is necessary to establish the novelty of the proposed method and better substantiate its effectiveness.
[a] Sequential Recommendation with User Memory Networks. WSDM 2018.
[b] TokenRec: Learning to Tokenize ID for LLM-based Generative Recommendation. TKDE. https://arxiv.org/pdf/2406.10450.
[c] VARIUM: Variational Autoencoder for Multi-Interest Representation with Inter-User Memory. WSDM 2025.
[d] Self-Evolving Memory for Generative Recommendation. https://arxiv.org/pdf/2609.15598.
- The paper lacks substantial comparisons with other state-of-the-art generative recommendation models. Such comparisons are important for determining whether the proposed user tokens provide tangible benefits over existing methods. Without these comparisons, it is difficult to assess the relative effectiveness of the proposed approach and establish whether its improvements are attributable to the proposed user memory mechanism rather than other factors.
- The evaluation relies exclusively on item SIDs from the existing OpenOneRec Rec-IF and the T5 generative recommender. Evaluating the proposed method with different tokenization strategies and generative recommendation architectures would provide more convincing evidence of its generalizability and effectiveness. Relying on a single tokenizer and generative recommender may introduce methodological bias and makes it difficult to determine whether the observed improvements are robust across different modeling choices.
Questions for authors
Please see the review.
2 comments
Thank you for providing a detailed response. However, the main concerns remain insufficiently addressed
- The underlying mechanism responsible for the performance improvements is still not convincingly established. The additional experiments demonstrate that predictive quantization performs better than conventional geometric quantization, but they do not adequately disentangle the respective contributions of long-term historical information, explicit user memory modeling, and cross-user collaborative signals. In particular, the observation that users sharing the same memory token exhibit similar future behavior does not necessarily demonstrate that the memory mechanism facilitates beneficial cross-user information transfer. More controlled ablation experiments are needed to isolate these factors.
- The discussion of related memory-based recommendation methods remains largely conceptual. Although the authors provide a comparison table describing the differences between the proposed method and existing approaches, they do not sufficiently establish the technical novelty or empirical advantages of the proposed method over closely related methods, particularly those involving collaborative tokenization and inter-user memory.
- The concern regarding comparisons with state-of-the-art generative recommendation models remains largely unresolved. The additional OneRec experiments only compare FULL and DeYi within the same architecture, rather than evaluating the proposed approach against representative state-of-the-art generative recommendation baselines. Consequently, it remains difficult to assess the relative effectiveness and competitiveness of the proposed method.
- Although the OneRec experiments with SID and PID provide some evidence of generalizability, the evaluation is still limited in terms of generative architectures, tokenization strategies, and recommendation scenarios. The current results are insufficient to establish that the proposed memory mechanism is robust across different modeling choices.
Thus, I would like to maintain my original score as it reflects my overall assessment of this paper.
We thank the reviewer for recognizing the motivation, controlled analyses, and results on large-scale recommendation tasks. We clarify the mechanism, relationship to prior work, and generalization below.
W1. What Drives the Gains: Long-Term History or Cross-User Collaboration?
DeYiΦ provides an explicit, reusable predictive interpretation of history. All variants in Tables 2–3 retain the complete interaction sequence. Dummy and Pooling offer little benefit, while continuous DeYi alone does not reproduce the gains from shared discrete memory. Thus, the benefit comes from how historical information is represented and used, rather than access to additional interactions.
Cross-user sharing is central to Φ. The key question is what different users should share. Φ groups memories by future-item predictions rather than behavioral or latent-space proximity.
To test this distinction, we fix the DeYi states, 256 memory codes, and TIGER generation interface, changing only the quantization criterion.
Table R1. Predictive vs. Geometric Quantization on Product (%).
Predictive quantization leads on all six metrics. Section 4.4 further shows that users assigned the same memory token exhibit more similar held-out future behavior than users assigned different tokens, across both domains.
Together, these results support prediction-aligned sharing as the mechanism that turns private user states into reusable memory identities, beyond generic history compression.
W2. Distinction from Existing Memory Methods
Our contribution is a shared discrete memory language whose identities are defined by future predictions and exposed to an autoregressive item-SID generator.
The four cited works address complementary aspects of recommendation memory:
Table R2. Comparison with Related Memory Methods.
DeYi learns what earlier interactions predict; Φ assigns predictively equivalent states a common identity. The generator then uses this identity alongside the unchanged native Item SID sequence.
The distinction is therefore in the semantics and sharing criterion of memory, rather than memory or discretization alone. Item SIDs encode what happened; memory tokens encode what those events predict. We will make these relationships more explicit in the revised related-work section.
W3 / W4. Generalization Beyond TIGER and a Single SID Interface
To evaluate a second generative architecture, we extend DeYiΦ to OneRec on Short Video, reporting both Semantic ID (SID) and Product ID (PID) recommendation metrics.
Table R3. OneRec on Short Video, Seed 2026 (%).
Compared with OneRec FULL, DeYiΦ improves all PID metrics and five of six SID metrics; SID Pass@32 remains higher for FULL. These results show that shared predictive memory can also benefit a different generative recommender and item-token interface.
Unlike comparing absolute scores across architectures, the within-OneRec comparison directly evaluates the contribution of predictive memory in that system.
Together with the original TIGER results on Product and Short Video, these findings support the applicability of shared predictive memory beyond a single generative backbone. Our three-seed Product evaluation further shows a Pass@32 gain in each generator initialization.