- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PD2, a paradigm shift from user-centric next-item prediction to item-centric multi-user generation, with the main use case being item cold-start. PD2 simultaneously generates multiple users from a given item via a non-autoregressive masked denoising process. Experiments on KuaiRand datasets demonstrated superior performance, especially for the cold-start setting.
Critical strengths
- The paper proposes a paradigm shift from U2I to I2U recommendation, which alleviates the bias against high-quality new items in the recommender system. Specifically, generating a pool of users given an item. This formulation addresses the practically important cold-start problem.
- The empirical experiment provides overall strong evidence for the effectiveness of the formulation and method. The paper evaluates cold, warm, and overall performance with other baseline methods. The results disentangled the benefits from problem formulation and detailed architecture design. The reported online engagement gains are practically meaningful.
Critical weaknesses
- Gap between theoretical analysis and practical experiments. The masked diffusion process is an over-statement of the deployed setting, which uses one-pass factorized retrieval rather than the iterative reverse process used in the theoretical proof. The architecture is not really permutation-invariant as claimed. This makes it unclear whether PD2 is a joint diffusion/set generator or a useful but more incremental multi-query masked retriever.
- Important information such as related work and online experiment setting/results are not properly discussed in the main text, only in the Appendix, which limits the coherency and completeness of the paper.
Questions for authors
- How were the user-to-item baselines adapted to the I2U setting for the baseline models? Can the authors provide more details to ensure it’s a fair comparison?
- In what precise sense is PD2 permutation-invariant and a joint diffusion generator, given its chronological positional encoding, temporal bias, factorized output channels, and one-pass inference? Have the authors compared the performance of PD2 with a non-diffusion multi-query retriever?
- Why KuaiRand datasets? Have the authors consider other datasets?
2 comments
Response to Reviewer gXVY - Part 2/2 (Q1 & Q3)
(Q1) The reviewers would like to know about the adaptation of U2I baselines to the I2U setting.
R: Thank you for your attention to baseline adaptation and the fairness of our comparisons. We would like to clarify that, to fairly compare the modeling capabilities of different methods for I2U cold-start recommendation, we adapt methods originally designed for U2I to the I2U setting while preserving their original architectures and core training mechanisms as much as possible.
First, we unify the task inputs and prediction targets. Traditional U2I methods typically take a user's historical item interaction sequence as input and predict the next item. In the I2U setting, we transform this into an item-centric historical user interaction sequence. Specifically, we construct a chronologically ordered user sequence based on each item's positive interaction records and predict the future interacting user. Accordingly, the prediction space is changed from the item vocabulary to the user vocabulary.
Second, we adapt different baselines according to their original modeling mechanisms. For sequential modeling methods, we preserve their original attention structures and sequence modeling mechanisms while adapting the inputs and prediction targets to item-centric user sequences. For generative methods such as DreamRec and DiffuRec, we change the generation target from future item representations to future user representations. For semantic-ID-based methods, we follow the standard practice of using Qwen3-4B to obtain multimodal embeddings and RQ-KMeans to construct semantic IDs, while retaining the next-token prediction task.
Finally, we adopt a unified experimental protocol to ensure fair comparisons. All methods use the same data splits, full user candidate vocabulary, and Recall@K/NDCG@K evaluation metrics. Furthermore, in Appendix C.3 (Table 5), we compare the same architectures under both U2I and I2U training formulations to distinguish the effects of changing the task formulation from those of the model architecture itself.
We have added detailed adaptation procedures for each baseline in Appendix B.3 (6) of the revised manuscript to improve experimental transparency and reproducibility.
(Q3) The reviewer would like to know why the KuaiRand datasets were selected.
R: Thank you for raising this question. KuaiRand dataset is one of the most widely used public datasets in the recommendation community. Its two public subsets provide complementary evaluation settings from different perspectives, and their scales exceed those of many existing public recommendation benchmarks.
Furthermore, to evaluate the generalization ability of beyond the short-video domain, we provide experiments on two Amazon dataset. (Appendix Table 4)
Response to Reviewer gXVY - Part 1/2 (W1 & Q2 & W2)
We are grateful for your positive feedback and the thoughtful evaluation of our work. Please see below for our response.
R: We would like to clarify that PD² adopts Masked Discrete Diffusion for conditional denoising training, while employing Single-pass Retrieval for efficient multi-user inference. Its main contribution lies in task-specific mechanisms designed to address the modeling mismatch between existing I2U approaches and the concurrent, multi-modal characteristics of item-side interactions.
First, our adoption of Single-pass Retrieval is a deliberate design choice. Appendix A analyzes the idealized Masked Discrete Diffusion objective and continuous-time reverse process. Under appropriate assumptions, the practical training objective supports the learning of optimal conditional predictions. However, Single-pass Retrieval directly generates multiple user-retrieval queries in one forward pass rather than executing an iterative reverse chain. In practical scenarios, Single-pass Retrieval trades a small amount of retrieval performance for reduced computational overhead. To illustrate this trade-off, we provide an additional comparison between two inference strategies on KuaiRand.
We have included the above comparative experiment in the revised manuscript (Lines 1227–1233).
Second, regarding permutation-invariant, We acknowledge that our claim of permutation invariance was overly broad, as incorporating RoPE introduces a trade-off between permutation invariance and positional modeling. However, narrowing the scope of this claim does not affect the conclusion of Theorem 1(ii). We have discussed this issue in detail. Please refer to our response to Reviewer Gs6w, W2 & Q1.
Third, comparison with Multi-query Retriever. We further construct a carefully adapted BERT-style Masked Retrieval baseline and progressively introduce parallel prediction and our task-specific components. The results on KuaiRand-Pure are shown below:
Simply extending Masked Retrieval to multiple parallel queries improves Diversity from 0.479 to 0.548 but reduces R@10 from 3.28 to 3.10. Introducing MGLP improves R@10 to 3.38, while incorporating IAST further increases R@10 to 3.60 and Diversity to 0.575. These results demonstrate that the improvements of PD² are not solely attributable to multiple queries, but also depend on the complementary mechanisms designed for I2U multi-user retrieval.
Finally, we provide additional experiments comparing PD² with two groups of non-diffusion multi-query retrievers.
We use SASRec and TIGER as base models and adapt them to support multi-query retrieval through two strategies:
We report the comparison results on KuaiRand-Pure below:
These results highlight the importance of complementary mechanisms specifically tailored to I2U multi-user retrieval.
[1] Li, Chao, et al. "Multi-interest network with dynamic routing for recommendation at Tmall." CIKM 2019.
R: Thank you for raising this point. Due to space limitations, we originally placed some discussions of related work and online A/B test results in the Appendix. To improve the coherence and completeness of the paper, we have moved the related work and the key results from the online A/B tests to the main text (Section 2 and Lines 474-475).