- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors first investigate the gap between item representations and user preferences in current generative recommendation systems. To address this, they propose a multi-stage training paradigm designed to progressively align item semantic representations with user preferences. Extensive experiments conducted across multiple recommendation datasets demonstrate the effectiveness of the proposed model. While this work builds upon previous research and offers a degree of innovation—supported by comprehensive experimental results—it has several limitations: some experimental outcomes are not particularly strong; the training pipeline is both lengthy and complex; and, unlike models such as TIGER, it cannot accommodate the continuous influx of new items, making it difficult to deploy in real-world industrial generative recommendation settings.
Critical strengths
This paper begins by addressing a long-standing challenge in the field of generative recommendation. While previous studies have attempted to tackle this issue, none have provided such a systematic analysis and investigation. The three-stage co-training framework proposed in this paper effectively aligns item semantic representations, user preference representations, and discrete SID token embeddings.
Furthermore, the paper presents a comprehensive set of experiments; ablation studies clearly demonstrate the necessity of each of the three proposed training stages, and the main experimental results outperform the vast majority of existing models.
Critical weaknesses
-
Some of the key experimental results in this paper are not particularly impressive. According to the data in Table 2 (ablation study) and Figure 5, the performance of the full DEGET (DE+GE+T) model is nearly on par with that of the dense recommendation model (DE) trained solely in the first stage; in fact, DEGET even underperforms DE on certain metrics.
-
The training pipeline proposed in this paper is overly complex, requiring three distinct stages—each with carefully designed training strategies and durations—which creates significant hurdles for future reproduction and practical deployment.
-
The model struggles to handle scenarios characterized by a continuous influx of new items. The pre-trained encoder and the RQ-based quantization codebook are ill-equipped to accommodate new items. Unlike TIGER, which demonstrates genuine industrial-readiness, this model—while a suitable topic for academic research—faces substantial limitations when it comes to real-world application.
Questions for authors
Could the authors elaborate on how the concepts presented in this paper can be practically applied to industrial-scale generative coarse-ranking or retrieval systems? If this approach could be utilized to model item representations and user behaviors within large-scale, dynamic environments, it would be an outstanding contribution.
4 comments
Response to Weaknesses 2 and 3, the Question, and Related Manuscript Revisions
[W2]
(a) We acknowledge that our training pipeline is more complex than single-stage baselines. However, the three progressive stages provide a path for converting existing dense recommenders into generative recommenders, enabling the reuse of established techniques from industrial practice and prior research:
For the DE-stage, an existing, well-trained dense recommender can serve as the foundation, avoiding the need to retrain it from scratch.
For the GE- and T-stages, the main design choices concern the training objectives for SID prediction. DEGET’s flexibility allows different training objectives established in prior work to be incorporated according to practical deployment requirements.
(b) The three proposed training stages are closely connected: DEGET first pretrains the encoder, then pretrains the decoder, and finally jointly fine-tunes the encoder–decoder. Compared with LLM-based GR pipelines such as OneRec-Think, which involve pretraining, supervised fine-tuning, and reinforcement learning, DEGET remains lightweight in model size and straightforward to implement, while achieving comparable recommendation performance on the evaluated benchmarks (Appendix E.3, Table 8).
(c) We directly compare the training efficiency of DEGET with that of TIGER and ActionPiece from Table 1 on Beauty, using the same backbone architecture. All experiments are conducted on a single NVIDIA L40 GPU, with training and evaluation batch sizes of 256 and 128, respectively. Hyperparameter settings follow Appendix D.3, Implementation Details. All models are trained to convergence. Total training time includes offline tokenization and validation during training:
| Method | Total training time (min) |
|---|---|
| DEGET | 73.74 |
| TIGER | 89.32 |
| ActionPiece | 1,971.64 |
Benefiting from both shorter offline tokenization enabled by reusing the frozen DE-stage projector as the RQ-VAE encoder and faster T-stage convergence enabled by initializing joint fine-tuning with the encoder pretrained in the DE-stage and the decoder pretrained in the GE-stage, DEGET achieves an end-to-end training time comparable to that of TIGER.
[W3]
We acknowledge that handling cold-start items remains a limitation of DEGET. Cold-start recommendation has been studied as a dedicated problem in GR, including Cold-Starts in Generative Recommendation: A Reproducibility Study (arXiv:2603.29845) and GenRecEdit (arXiv:2603.14259, SIGIR 2026). Nevertheless, DEGET offers two potential avenues for mitigating this issue in industrial applications:
(a) Reusing dense recommenders designed for cold-start scenarios. DEGET can use an existing industrial dense recommender with cold-start capabilities as its DE-stage foundation. Such a recommender could provide user query representations that generalize to the semantic features of unseen items, while also producing input representations for new items from their content.
(b) Incorporating advances in SID construction and generative recommendation. DEGET’s transfer strategy can be adapted to incorporate techniques developed for cold-start recommendation. We have already demonstrated its applicability to TIGER with RQ-VAE tokenization and ActionPiece with OPQ-based item quantization, and further extended it to RPG with parallel SID prediction (Appendix I, DEGET-RPG). This flexibility provides a basis for integrating cold-start techniques across different tokenization strategies and generation architectures, although their effectiveness within DEGET requires dedicated cold-start evaluation.
[Q]
Building on our responses to [W1]–[W3], we highlight three practical implications:
(a) Reusing existing dense recommenders. DEGET can reuse pretrained item representations and history encoders to build a generative retriever, avoiding dense pretraining from scratch. Appendix G.1 demonstrates this conversion using SASRec.
(b) Integrating into existing recommendation pipelines. DEGET generates candidate-item SIDs for downstream ranking without full-catalog dense scoring. For generative coarse-ranking, a possible extension is to score a supplied candidate set using SID sequence likelihoods.
(c) Scaling and adapting to dynamic catalogs. Sampled objectives provide an alternative to full-catalog dense training. Content-based encoders can represent newly arriving items, while reliable generation of their SIDs still requires incorporating cold-start adaptation techniques.
[Related revisions]
All newly added content is highlighted in blue in the revised manuscript.
- Additional analyses. We have revised Appendix F (DE vs. DEGET) to include detailed analyses addressing [W1].
- Practical applications. Following our discussion with you, we will add a dedicated appendix section outlining the concepts and directions for practical applications of DEGET.
A Gentle Follow-up on Our Responses
Dear Reviewer NFyW,
We appreciate your careful assessment of our work, your recognition of its contributions, and your constructive feedback on practical deployment.
We have carefully responded to your concerns by (1) expanding the comparison between DE and DEGET, with additional results on the larger Amazon Reviews 2023 benchmarks and experiments incorporating a self-distillation objective on the 2014 benchmarks to clarify the role of training objectives in the performance differences; (2) clarifying the flexibility of the three training stages, comparing DEGET with LLM-based GR, and reporting end-to-end training costs, including offline tokenization and validation; (3) acknowledging the remaining cold-start limitations and outlining potential adaptation strategies, including reusing dense recommenders with cold-start capabilities and incorporating advances in SID construction; and (4) elaborating on potential industrial applications, including reusing pretrained dense recommenders, integrating generative retrieval into existing pipelines, and extending DEGET to generative coarse-ranking. The additional DE–DEGET analyses have been incorporated into Appendix F, with newly added content highlighted in blue. We also plan to add a dedicated appendix section on practical applications following our discussion with you
We value your perspective on DEGET’s practical applicability and sincerely hope these clarifications and additional results strengthen your confidence in our work. We would welcome your feedback and further discussion.
Best regards,
The Authors of Submission 31765
A Gentle Follow-up on Our Responses — Final Day of Discussion
Dear Reviewer NFyW,
We appreciate your thoughtful review and your insights into the practical applicability of our work.
With the discussion period ending today, we would welcome your feedback on our clarifications and additional results. If these have addressed your concerns, we would be grateful if you could consider updating your assessment and score.
Best regards,
The Authors of Submission 31765
Response to Weakness 1
We sincerely thank you for recognizing our contributions and raising practical concerns! We address these concerns from several practical perspectives below and welcome your further feedback.
[W1]
We acknowledge this limitation on the Amazon Reviews 2014 benchmarks. DEGET may slightly underperform DE while remaining close to its performance.
DR and GR differ in both architecture and recommendation paradigm, including decoder use, item representations, training objectives, and inference procedures. Internalizing DR knowledge therefore does not imply that GR must outperform DR. Our transfer strategy enables the final generative model to outperform existing GR baselines such as TIGER and ActionPiece (Table 1), while Figure 5 shows that DEGET internalizes the discriminative capabilities of DR to a substantial extent.
We further note that two main factors may explain why DEGET does not consistently outperform DE in Table 2: dataset scale and training objectives.
(a) Data scale. The Amazon Reviews 2023 benchmarks contain approximately 0.41–0.81 million interactions per dataset, compared with 0.17–0.30 million in the 2014 benchmarks (Appendix D.1, Table 5). On these larger datasets, the additional comparison below shows that DEGET exceeds DE across all metrics.
This pattern is consistent with the observations in S²GR (arXiv:2601.18664, KDD 2026): traditional DR methods remain competitive on its small-scale dataset, while GR methods exhibit stronger relative performance on its large-scale industrial dataset.
(b) Training objectives. As stated in Sec. 3.2, token-level likelihood training does not explicitly compare the target item against all competing items in the catalog. Recent works, including TCA (arXiv:2601.18457), GFlowGR (arXiv:2506.16114), and REGER (arXiv:2610.37584), use external DR models to provide distillation targets or reward signals for training GR models. Our staged design allows us to retain a frozen copy of the GE-stage encoder as the teacher during the T-stage, adapting such supervision into self-distillation without introducing an external teacher to bridge the training-objective gap. Specifically, we adopt REGER’s Hierarchical Collaborative Preference Distillation (HCPD) on the 2014 benchmarks.
For further details, please refer to Appendix F of the revised manuscript.