Skip to main navigation Skip to search Skip to main content

FGCM: modality-behavior fusion model integrated with graph contrastive learning for multimodal recommendation

Feng Mo, Lin Xiao*, Qiya Song*, Xieping Gao, Wenzhuo Song, Shoujin Wang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Multimodal recommender systems (MRSs) aim to integrate information from multiple modalities, for better capturing users' preferences. However, existing MRSs usually face the challenge of data sparsity, especially for the limited user-item interactions. It is not uncommon that a user interacts with only a few items out of millions. More importantly, the interaction information is easy to be overwhelmed, leading to poor recommendation performance. To tackle these significant gaps for further improving the performance of MRSs, we propose a Modality-behavior Fusion Model Integrated with Graph Contrastive Learning for Multimodal Recommendation (FGCM). First, through the introduction of random noise into graph contrastive learning, FGCM adeptly mitigates data sparsity. Then, a modality-behavior fuser is proposed to effectively fuse interaction data and multimodal side information data by taking cooperative signals and multimodal signals as the guidance. Extensive experiments on three datasets demonstrate that our proposed approach outperforms several state-of-the-art methods.

Original languageEnglish
Pages (from-to)27-37
Number of pages11
JournalIEEE Multimedia
Volume32
Issue number3
Early online date20 Feb 2025
DOIs
Publication statusPublished - 2025
Externally publishedYes

Fingerprint

Dive into the research topics of 'FGCM: modality-behavior fusion model integrated with graph contrastive learning for multimodal recommendation'. Together they form a unique fingerprint.

Cite this