- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focuses on the challenge of feature fusion in multimodal sequential recommendation. The authors argue that directly fusing textual, visual, and ID-based representations may improve recommendations for long-tail items, yet it could simultaneously compromise performance for popular items.
To address this, the authors propose the PRISM framework. It begins by decomposing multimodal features into shared semantic components and modality-specific components, which are then refined through distribution alignment and prototype-level optimal transport. Subsequently, the multimodal sequences are processed using FFT and a frequency-domain gating mechanism. Finally, these enhanced features are integrated with ID sequences via cross-attention to generate recommendations.
Experiments conducted on datasets such as Fitness, Game, and Dogs demonstrate that PRISM consistently outperforms the baseline methods. Furthermore, ablation studies show the effectiveness of the framework's core modules.
Critical strengths
- The authors analyze the performance disparity between popular items and long-tail items in multimodal sequential recommendation, and propose adjusting features at both the item and sequence levels. In particular, they employ distinct processing strategies for shared semantic information versus modality-specific semantic information.
- The experimental analysis in the paper is quite comprehensive. Beyond achieving strong results across multiple datasets, the authors further validate the effectiveness of their approach through ablation studies, performance comparisons across varying interaction frequencies, and an analysis of gained hits versus lost hits.
Critical weaknesses
1.The authors argue that their method can reduce the interference of multimodal information on recommendation performance. However, as shown in Equation (9) in the main text and Equations (20–23) in the appendix, this module primarily functions by adaptively enhancing different frequency components, rather than directly suppressing noise. Furthermore, Equations (21–23) indicate that the effective gain of the frequency-domain gating mechanism consistently falls between 1 and 2, implying that the original frequency components are never directly attenuated. Consequently, it remains unclear whether and how this enhancement mechanism effectively mitigates interference from multimodal information while simultaneously preserving recommendation performance for popular items. The experimental comparison of frequency domain modules is not sufficient. The ablation experiment is just replaced by ordinary MLP. However, there are already many sequence recommendation methods based on frequency domain modeling. It is recommended to compare with other frequency domain filtering or adaptive frequency modeling methods.
- The paper needs to clarify the novelty of its proposed modules. For instance, the separation of shared semantics from modality-specific semantics within the Cross-Modal Semantic Reshaping component, as well as the cross-modal alignment approach based on Gaussian prototypes and Optimal Transport, bears a strong resemblance to the methodology used in DecAlign. Since DecAlign already employs similar mechanisms for semantic disentanglement, prototype-based optimal transport, and distribution alignment, this paper must explicitly delineate its own distinct contributions relative to existing approaches.
Questions for authors
please refer to the weaknesses