- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ProtoAdapter, a data-centric framework for adapting pretrained generative recommenders to new domains. It constructs a bank of shared behavioral prototypes, retrieves relevant patterns, and selects history-specific evidence to generate structured training traces using a teacher model. Trace-augmented and direct-answer supervision are jointly employed during CPT and SFT, while inference retains direct item-token generation. Experiments on three datasets using Qwen3 and OneRec demonstrate consistent ranking improvements, particularly under limited training data.
Critical strengths
S1. Well-motivated and practical framework. Combining domain-level behavioral prototypes with history-specific evidence provides a reasonable approach to sparse-domain adaptation. Offline trace construction also avoids additional inference-time overhead.
S2. Consistent empirical improvements. The method improves two different backbones across three datasets, with particularly encouraging gains in low-data settings. The shuffled and cross-domain trace ablations further support the importance of coherent supervision.
Critical weaknesses
1.Insufficient isolation of the core contributions. The ablations do not separately establish the benefits of prototype retrieval and local evidence selection. Since the training target also guides trace construction, the gains may partly arise from target-aware rationale distillation rather than the proposed two-scale mechanism.
- Incomplete efficiency and validation analysis. Offline prototype construction and teacher-based trace generation introduce additional costs that are not quantified. The low-data protocol and statistical evidence also require clarification to better establish the claimed data efficiency.
Questions for authors
-
It would be helpful to include a teacher-generated rationale baseline without prototypes, along with prototype-only and evidence-only ablations, to better understand the contribution of each component.
-
Are prototype banks rebuilt using only the corresponding 10%/50% training subsets? Reporting offline construction costs and comparing against direct training under similar computational budgets would also help assess the practical efficiency of the method.
3 comments
Thank you for the detailed rebuttal and additional experimental results. I appreciate the authors' efforts to address my concerns. The prototype-only and evidence-only ablations, together with the generic-summary and matched-budget controls, provide stronger evidence for the effectiveness of the proposed framework. The clarification of the low-data protocol, statistical results, and offline construction costs also improves the overall experimental evaluation.
Nevertheless, some limitations remain. While the new ablations demonstrate that both evidence sources contribute to performance, their measured interaction is relatively small, leaving the extent of their synergistic benefit less clear. Moreover, although the matched-budget controls improve comparison fairness, the additional offline construction costs are not fully considered in an end-to-end cost-effectiveness evaluation.
Overall, the rebuttal has satisfactorily addressed most of my original concerns and strengthened the empirical evidence. However, I believe my original rating still appropriately reflects the paper's contributions and remaining limitations. Therefore, I will maintain my rating of 3 (Weak Acceptance).
Thank you again for your careful review, and if you have any new questions in the future, you are welcome to continue the discussion with us!
Response to Reviewer 9h3q
Thank you for recognizing the complementary motivation and the direct-decoding setting. We respond in two parts.
Table 1: Low-data results with independently rebuilt banks
The larger relative benefit under limited data remains after rebuilding all construction assets. As an additional diagnostic, using a full-data bank with 10% student-training data gives 2.91 NDCG@5, compared with 2.75 for the strict 10% bank. The former measures access to a larger training bank, while the latter measures performance under a complete 10% construction budget. Shared Table S3 gives the complete offline account: teacher generation takes 5.6, 19.7, and 14.9 A100-hours on All_Beauty, KuaiRec, and KuaiRand, and adaptation takes 9.4, 31.2, and 24.6 A100-hours. At deployment, OneRec and OneRec+ProtoAdapter have p50 latencies of 118ms and 119ms on the pooled 6,144-request held-out evaluation (2,048 per dataset), and peak allocated memory of 19.8GB and 19.9GB.