- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes Scale-aware SIDs. In traditional RQ-VAE methods, after selecting a codeword at each layer, the residual and the codeword are not orthogonal, which leads to residual semantic information. This paper uses a geometric approach to ensure that the residual remains orthogonal to the selected codeword. Meanwhile, the residual achieves a minimum L2 norm, allowing different codebooks to fully explore semantic information, thereby improving codebook utilization. The reviewer speculates that the authors might have been inspired by Gram-Schmidt orthogonalization and transferred this concept to semantic vector orthogonality.
Critical strengths
-
The mathematical proof is concise and very intuitive from a geometric perspective. The algorithm is also easy to implement and plug-and-play, which is a highly important advantage.
-
The empirical validation across three recommender training paradigms demonstrates the algorithm's effectiveness. Furthermore, the detailed analysis of codebook utilization and collision rates is another significant advantage.
Critical weaknesses
-
The experimental results deserve further analysis.
-
More diverse backbones and evaluation datasets should be evaluated to further validate the effectiveness.
-
More related work on generative recommendation should be discussed in this work.
Questions for authors
I compared the results on the Beauty dataset in Table 2 of this paper with Table 1 in the original LETTER paper, both of which use LETTER and SASRec as baselines. I reviewed the original LETTER paper and noticed that while your reproduced results for LETTER are comparable to the original paper, there is a significant discrepancy regarding the SASRec baseline. In your paper, SASRec achieves a Recall@5 of only 0.0284, which is even lower than BERT4Rec (0.0322). However, in the original LETTER paper, SASRec achieves a Recall@5 of 0.0380 (significantly outperforming BERT4Rec). Could you please explain the reason for this discrepancy?