- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
This paper studies personalized generation for recommender systems. To reduce the information loss caused by cascaded pipelines, the paper proposes RIGC, an end-to-end unified framework for recommendation and generation. It first predicts the next item and then produces personalized marketing text and image. RIGC is trained through a five-stage SFT procedure and a newly designed Nested-GRPO method. The authors also construct IndusAds-MM from large-scale industrial advertising logs. Experiments show that RIGC outperforms several recommendation and generation baselines across all reported metrics.
Critical strengths
The paper studies personalized multimodal generation for recommender systems, which is relevant to real-world content-delivery and advertising applications. It also provides a valuable attempt to integrate item recommendation, personalized text generation, and visual content generation into a single end-to-end framework.
Critical weaknesses
-
Insufficient ablation studies. The five-stage training pipeline and Nested-GRPO contain many intertwined design choices, but the paper provides few controlled ablations. See Question 3 for details.
-
Unclear experimental setup and baseline comparison. The paper does not clearly specify what information each baseline receives, making it difficult to assess whether the experiments fully support the claimed advantage of the unified framework. See Question 7 for details.
Questions for authors
-
According to the introduction and the bottom-right example in Figure 1, RIGC can restyle a generated keyframe into different visual styles. It would strengthen the paper if the authors could evaluate RIGC on general image-generation and editing benchmarks. This would help determine whether the RIGC training comes at the cost of its general multimodal capabilities.
-
The relationship between the multi-level SID representation and the expanded vocabulary is not sufficiently clear. The paper reports that 32,770 rows are appended to the vocabulary, but does not explain how the SID tokens are constructed or mapped to these new entries. It would be helpful if the authors could clarify the complete SID tokenization scheme and report relevant statistics, such as the number of active codes at each level.
-
The five-stage training pipeline contains many carefully designed components, but most of them lack ablation studies. Such experiments are needed to better identify the contribution of each component. In particular, the authors should investigate: (1) the size of the expanded SID vocabulary; (2) the data-mixture ratios in Stages 2 and 4; (3) the parameter-freezing strategy in each stage; and (4) the relative weights of the autoregressive and flow-matching losses in Stage 5. It would also be useful to examine whether all five stages and their current ordering are necessary.
-
According to the appendix, Nested-GRPO uses and . This results in rollouts. Since every rollout includes image generation, the computational cost may be substantial. The paper would be more convincing if the authors reported the configuration details such as rollout parallelism, training time, and GPU usage for both the SFT and Nested-GRPO stages.
-
During Nested-GRPO training, the reward is provided by a user-feedback simulator trained by the authors. It would be better if the authors could provide additional evidence to rule out reward hacking. The authors should also provide more information about the simulator's training data such as the number and distribution of low-, medium-, and high-interest samples.
-
The paper uses a very large industrial dataset, but the reported statistics are mainly limited to aggregate counts. It would improve the transparency of the dataset if the authors could show more detailed statistics and visualizations.
-
One of the paper’s central claims is about end-to-end frameworks versus cascaded systems. Therefore, the evaluation settings for the baselines are crucial to judge this comparison. It would be better if the authors could clarify what information each baseline receives (such as the ground-truth item, the complete user history, or a reference image). A controlled comparison between these two methods using the same experimental setup is necessary. Besides, the relationship between recommendation accuracy and keyframe quality also requires further explanation. As RIGC achieves only 0.1300 Recall@10 on IndusAds-MM, if a single predicted SID is used for subsequent generation, an incorrect recommendation will influence the marketing text and keyframe. An oracle experiment that provides the ground-truth SID would help distinguish recommendation errors from text- and image-generation errors.
Thank you for the responses and additional experiments. These have addressed some of my concerns. I have two remaining questions:
For BAGEL and SenseNova-U1 in Table 2, are text and images generated directly from the user profile and history, without selecting a specific item from the catalog?
How are Recall/NDCG computed for IndusAds-MM in Table 3? If they measure product-level recommendation accuracy, how is a predicted SID mapped back to a unique product, given that one SID may correspond to multiple advertisements?