- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes CORE, short for COntent REpresentation, a novel approach for multimodal recommendation. The main rationale of the methodologies lays in the presence of two principal signals in multimodal recommendation, namely, multimodal content and presentation bias; in this respect, the authors claim the latter is directly related to popularity bias of items and largely influences recommendation performance. To better formalize the scenario, the authors leverage causal graphs, and propose to learn two disentangled representations of content and presentation for each item. To begin with, the model encodes the visual and textual modalities with a learnable multi-layer perceptron preceded by a concatenation of the two modalities. After that, it uses two separate encoders (again, implemented as multi-layer perceptrons) for the content and presentation representations, and establish a twofold contrastive learning paradigm: the first one accounts for the content, and ensures items with same content but different presentation should be close in the latent space; the second one accounts for the presentation, and ensures items with same popularity but different content are close in the latent space. Then, an independence loss built around the Hilbert-Schmidt Independence Criterion (HSIC) ensures the independence of the two learned representations. Finally, the methodology adopts a LightGCN predictor to compute the user-item scores, and train a BPR-like loss function augmented with the above-described loss components. Results on three recommendation datasets and against nine state-of-the-art recommendation models spanning different families of approaches demonstrate the efficacy of the CORE methodology. Additional ablation studies and hyper-parameter sensitivity analyses further confirm the goodness of the architectural choices, while a visual embedding representation demonstrates the different learning capabilities of the content and presentation embeddings.
Critical strengths
I think the paper has the merits to identify a critical problem in multimodal recommendation, namely, how presentation bias might largely drive recommendation at the detriment of multimodal content. This is also supported by related literature, and the authors nicely formalize this under the causal inference paradigm. The methodology is clearly explained and quite simple, which I identify as another strong point in favor of the paper.
Critical weaknesses
I think that one of the main critical points of the paper lays in the design of the heuristics to select items with similar content but different presentations, especially as described in Section 4.3.1. I believe that using the textual modality to ensure two items are similar content-wise, but with different variations of the same image to say the two items are dissimilar presentation-wise, is a too much simplistic assumption. First, while I understand the visual modality might be one of the main driving factors for products on e-commerce, this might not be always the case in other domains, such as music recommendation. Additionally, I think that also the textual content might sometimes lead to presentation bias, for instance with items' descriptions that enhance the item's true content with exaggerated characteristics and details. While I acknowledge the authors provide a preliminary discussion on these aspects in Section A.2 from the appendix, I would expect further clarifications on this point, that is crucial for the whole design of the paper.
Experiments-wise, the paper lacks further multimodal baselines, where VBPR and MMGCN are quite outdated methods. I would suggest adding other more recent baselines to the benchmark, such as PGL [1], SMORE [2], and COHESION [3] to ensure the timeliness of the proposed model and its empirical evaluation.
References
[1] Penghang Yu, Zhiyi Tan, Guanming Lu, Bing-Kun Bao: Mind Individual Information! Principal Graph Learning for Multimedia Recommendation. AAAI 2025: 13096-13105
[2] Rongqing Kenneth Ong, Andy W. H. Khong: Spectrum-based Modality Representation Fusion Graph Convolutional Network for Multimodal Recommendation. WSDM 2025: 773-781
[3] Jinfeng Xu, Zheyu Chen, Wei Wang, Xiping Hu, Sang-Wook Kim, Edith C. H. Ngai: COHESION: Composite Graph Convolutional Network with Dual-Stage Fusion for Multimodal Recommendation. SIGIR 2025: 1830-1839
Questions for authors
My main questions are related to the above concerns.
-
Can the authors elaborate further on the choice of the heuristics to flag items according to presentation? Additionally, did the authors try to run the same empirical pipeline of CORE, by considering another modality as the one used for presentation? So, instead of images, using text for the contrastive learning part.
-
Did the authors try to assess the performance of CORE on datasets with more than 2 modalities? What are the main methodological and performance implications? As an example, authors might refer to this recent dataset
.
References
Y. Ni, Y. Cheng, X. Liu, J. Fu, Y. Li, X. He, Y. Zhang, and F. Yuan, “A content-driven micro-video recommendation dataset at scale,” in CIKM, 2025.