- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces a prior-fitted model called ICR for sequential recommendation without target-domain training. The model learns from synthetic sequences and uses random item embeddings, identity-restricted cross-attention, and a pointer head for prediction. The authors also provide some theoretical analysis to support the design. Experiments are conducted on 11 datasets, covering comparisons with zero-shot, supervised, and retrieval-based methods.
Critical strengths
- Identity-restricted cross-attention and the pointer head provide a reasonable way to handle larger support contexts without target-domain training.
- The paper covers 11 datasets, includes recent 2026 baselines, and provides multiple runs and context-scaling analyses.
Critical weaknesses
- I notice that ICR uses 128 support sequences by default, but RecPFN uses only 8. Although context-scaling experiments are provided, this difference may affect the reliability of the main comparison.
- There seems to be some inconsistency. Theorem 3 allows repeated items, but Appendix F.3 enables repeat suppression during synthetic sequence generation. This difference deserves further clarification.
- The benefit of IRCA seems to be concentrated on Dianping. Removing it causes a large performance drop on this dataset but has little effect on the other five datasets. Its effectiveness across different data distributions may need further investigation.
Questions for authors
- Could the authors explain why RecPFN is evaluated with only 8 support sequences, compared to 128 for ICR?
- Could the authors clarify how the full-support guarantee in Theorem 3 relates to the actual synthetic data generation process, where repeat suppression is enabled?
- Could the authors further explain why IRCA provides a substantial improvement on Dianping but only marginal gains on the other datasets?
3 comments
I appreciate the authors' efforts to address my concerns. The matched-context scaling analysis is helpful and largely alleviates my concern about the different support sizes used for ICR and RecPFN. The clarification regarding repeat suppression is also reasonable.
However, the revised manuscript (which I have downloaded at 2026-11-16 11:03 am) still lists repeat suppression as enabled for both training stages in Table 8, which remains inconsistent with the authors' response. I encourage the authors to correct this discrepancy. Finally, the additional popularity statistics provide a plausible explanation for the dataset-specific gains of IRCA on Dianping, but the underlying relationship is not yet sufficiently established.
Overall, I acknowledge the improvements and find the responses helpful. Nevertheless, some concerns remain, particularly regarding the consistency between the theoretical guarantee and the actual implementation. I therefore prefer to maintain my original rating.
Thank you for acknowledging the improvements and for your continued feedback. We have just uploaded the revised manuscript; the version you downloaded preceded this update. The incorrect repeat-suppression entries in Table 8 and the unused step in Algorithm 1 have now been removed to reflect the actual training configuration. If any concerns remain after this update, we would appreciate clarification and the opportunity to address them.
We would like to thank the reviewer for the thoughtful review and for recognizing the context-scaling design, broad benchmark coverage, and multiple-run evaluation. We will address the reviewer concerns below:
We used 8 support sequences for RecPFN because this is its default context size in the original paper, and provides a strong operating point rather than disadvantaging it with an oversized context. Our context-scaling experiments show that RecPFN peaks at small contexts and then degrades as more support is added, consistent with the context sensitivity reported in the RecPFN paper. Thus, increasing its headline budget to 128 would weaken it as a baseline.
Importantly, the context-scaling section also compares performance at matched context sizes, sweeping from 2 to 1024 support sequences per query. ICR outperforms RecPFN and SRPFN across all tested context sizes in the aggregate comparison. As context grows, ICR improves with diminishing returns, RecPFN degrades after its early peak, and SRPFN remains relatively constant.
Thank you for identifying this discrepancy. Repeat suppression was not enabled in either training stage. The training configurations set
repeated_items=True, meaning repeated items are allowed; the exclusion branch runs only when this flag is false. This can be verified by referring to the linked code repository in the paper. The "repeat suppression enabled" entries in Table 8 are therefore a documentation error, which we will correct, together with the conditional presentation of the optional step in Algorithm 1. We apologize for the error and thank the reviewer for identifying it.Dianping has a substantially weaker global popularity head than the other ablation datasets: its most popular 1% of items account for only 7.2% of training interactions, compared with 16.3-35.1% elsewhere. We believe this suggests that query-specific evidence is particularly important on Dianping, making the benefit of explicitly identity-aligned attention plausible.