- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work empirically identifies a “Markovian characteristic” common in modern sequential recommenders: predictions are dominated by the latest interaction, while earlier items mostly serve as non-sequential context for user identity. Based on this insight, it proposes MPT, pre-trained entirely on synthetic Markov chains, which achieves competitive next-item recommendation by fine-tuning only a lightweight input adaptor. It also analyzes scaling behavior and derives a theoretical Bayes-optimal performance limit.
Critical strengths
(1) Unlike prior works that manually built Markovian structures into architectures, this paper empirically shows that even expressive sequential models spontaneously operate in a Markovian mode. It then proposes pre-training on pure synthetic Markov chains, wichi is a counterintuitive idea opening a interesting direction for universal recommendation pre-training. (2) It starts with systematic shuffle experiments to demonstrate the Markovian property, then designs the pre-training task to match those required capabilities, then validates extensively with benchmarks, scaling analysis, attention maps, and theoretical limits. The logic builds cleanly from insight to method to evidence. (3) Matches standard SASRec inference speed while outperforming both dedicated pre-training and LLM-based methods.
Critical weaknesses
(1) The Markovian property breaks down on platform-driven datasets (e.g. MovieLens), and all main tests are on e-commerce. The method’s real scope is not clearly bounded. (2) The paper shows empirically that synthetic-to-real transfer works, but provides little theoretical explanation for why ideal Markov chains transfer to real user behavior. (3) The Transformer backbone is completely standard, and all contribution comes from the data paradigm, leading to limited technical depth. (4) Unbalanced LLM baseline comparison. Qwen2.5-7B is orders of magnitude larger than MPT; zero-shot and cross-domain LLM strengths are not evaluated. (5) There’s no control test with a randomly initialized backbone plus the same adaptor fine-tuning. You can’t be sure the gains come from Markov pre-training vs. just the adaptor learning the task from scratch.
Questions for authors
(1) The core “Markovian characteristic” finding is tested almost entirely on short-session e-commerce datasets. How do we know this is a property of the models themselves, rather than just a property of these datasets (which are naturally close to first-order Markov dynamics)? Have you tested this pattern on longer-sequence, strongly sequential domains like content recommendation? (2) There’s no control experiment with a randomly initialized backbone plus the same lightweight adaptor fine-tuning. How can we be sure the performance gains come from capabilities transferred via Markovian pre-training, rather than the adaptor simply re-learning the task from scratch on downstream data? (3) Have you compared MPT to similarly sized small language models, and tested it in zero-shot / cross-domain settings?
12 comments
[2/4] LLM baseline comparison [W4, Q3]
Responses
-
Why was Qwen2.5-7B selected? We selected Qwen2.5-7B because it is widely used, and models with 7B parameters are a common choice in prior work on LLM-based recommendation.
-
NDCG@10 Results for Qwen3-0.6B. We acknowledge the reviewer's concern regarding a fair comparison and provide additional results for the smaller Qwen3-0.6B model.
Beauty Toys Sports Yelp Retail Qwen2.5-7B 0.0464 0.0433 0.0256 0.0204 0.0731 Qwen3-0.6B 0.0565 0.0579 0.0316 0.0219 0.0735 MPT 0.0673 0.0705 0.0373 0.0224 0.0741 Qwen3-0.6B achieves better results than Qwen2.5-7B but still underperforms MPT across all five datasets. These results further motivate the question raised by the attention maps in Figure 4c: does language pre-training provide mechanisms that adapt effectively to recommendation tasks?
-
Zero-shot / Cross-domain settings. MPT requires recommendation-specific fine-tuning because its pre-training and downstream task spaces differ. Figure 6 demonstrates its ability to adapt with limited downstream data. Moreover, all results in Table 1 use the same pre-trained backbone, with a separate adaptor fitted to each downstream domain. This demonstrates its reuse across multiple recommendation domains.
[3/4] Control Experiment with a Randomly Initialized Backbone [W5, Q2]
Misunderstandings
-
We would like to clarify that Table 9 already reports a control experiment using a randomly initialized backbone with the same lightweight adaptor fine-tuning procedure. The results are reproduced below:
Beauty Toys Sports Yelp Retail Randomly initialized 0.0623 0.0664 0.0336 0.0221 0.0679 Markovian pre-trained 0.0673 0.0705 0.0373 0.0224 0.0741
Changes
- We have replaced "Training from scratch" with "Randomly initialized" to avoid confusion.
[1/4] Scope of the "Markovian Characteristic" Finding [W1, Q1]
Responses
Is the "Markovian characteristic" primarily observed in e-commerce scenarios? NO. We evaluate two additional widely used datasets from non-e-commerce domains, Steam and LastFM. The SASRec NDCG@10 results below show that the "Markovian characteristic" can also be observed in these settings:
How do we know this is a property of the models themselves, rather than just a property of these datasets? As discussed in the manuscript, establishing that the "Markovian characteristic" holds across all scenarios is neither technically feasible nor necessary for our main argument. Our central point is that the ability of advanced sequential recommenders to make predictions in a "Markovian" fashion may offer useful insights for developing universal recommenders.
Misunderstandings
[1] Harper F. M., et al. The movielens datasets: History and context. TIIS, 2015.
[2] Woolridge D., et al. Sequence or Pseudo-Sequence? An Analysis of Sequential Recommendation Datasets. RecSys, 2021.