- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In this paper, the authors design a post-encoder aggregation module, MARS (Multi-rate Aggregation of Recency Signals), and integrate it into existing networks such as Transformer and Mamba. The authors conclude that a separate controlled modelling of temporal readout can be valuable for the sequential modeling task. Comprehensive experiments compare the proposed methods with multiple baseline models with varying architectures and show that the proposed methods achieve state-of-the-art performance across recommendation datasets while maintaining computational efficiency.
Critical strengths
-
A major highlight of this work is the conceptual decoupling of temporal modeling from sequence representation. By designing MARS as a post-encoder aggregation operator rather than an in-encoder modification, the authors propose a highly modular solution. This decoupling not only yields a clean architectural design but also ensures that the proposed module can easily adapt to future advancements in underlying backbone networks.
-
The proposed post-encoder module, MARS, can be applied to existing sequential modeling networks, and ablation experiments verify the performance gain caused by the proposed MARS. Importantly, the authors transparently report their experimental results, including instances where prior method, e.g., TiSASRec, maintain the strongest performance on specific datasets like the Games dataset. The authors declare that their experiments are from different rounds of running.
Critical weaknesses
Sequential modeling is not the reviewer's main research focus. The reviewer's main concerns are listed as follows.
-
The efficiency comparisons inTable 5 show a counter-intuitive phenomenon: on datasets like Beauty and ML-1M, MARS-T achieves lower MFLOPs compared to the vanilla SASRec. Given that MARS-T is essentially SASRec appended with the proposed MARS module, the computational cost should theoretically be strictly greater than (or equal to) the base encoder. Could the authors clarify the underlying reason for this reduction in MFLOPs?
-
The authors set the τ as a fixed constant number, 1 hour. Could the authors provide any insight about this parameter selection?
Questions for authors
Please see the weaknesses.