ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation

Yuting Liu, Enneng Yang, Yizhou Dang, Guibing Guo, Qiang Liu +3 more
11/10/2023
cs.IRcs.LG

No confident code implementation found for this paper.

Abstract

Multimodal recommendation aims to model user and item representations comprehensively with the involvement of multimedia content for effective recommendations. Existing research has shown that it is beneficial for recommendation performance to combine (user- and item-) ID embeddings with multimodal salient features, indicating the value of IDs. However, there is a lack of a thorough analysis of the ID embeddings in terms of feature semantics in the literature. In this paper, we revisit the value of ID embeddings for multimodal recommendation and conduct a thorough study regarding its semantics, which we recognize as subtle features of \emph{content} and \emph{structure}. Based on our findings, we propose a novel recommendation model by incorporating ID embeddings to enhance the salient features of both content and structure. Specifically, we put forward a hierarchical attention mechanism to incorporate ID embeddings in modality fusing, coupled with contrastive learning, to enhance content representations. Meanwhile, we propose a lightweight graph convolution network for each modality to amalgamate neighborhood and ID embeddings for improving structural representations. Finally, the content and structure representations are combined to form the ultimate item embedding for recommendation. Extensive experiments on three real-world datasets (Baby, Sports, and Clothing) demonstrate the superiority of our method over state-of-the-art multimodal recommendation methods and the effectiveness of fine-grained ID embeddings. Our code is available at https://anonymous.4open.science/r/IDSF-code/.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{liu2023embedding,
  title  = {ID Embedding as Subtle Features of Content and Structure for Multimodal Recommendation},
  author = {Yuting Liu and Enneng Yang and Yizhou Dang and Guibing Guo and Qiang Liu and Yuliang Liang and Linying Jiang and Xingwei Wang},
  year   = {2023},
  eprint = {2311.05956},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.05956v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.05956.svg)](https://codeofpaper.com/paper/2311.05956)

Discussion