Learnable model augmentation contrastive learning for sequential recommendation

Yongjing Hao, Pengpeng Zhao*, Xuefeng Xian, Guanfeng Liu, Lei Zhao, Yanchi Liu, Victor S. Sheng, Xiaofang Zhou

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Sequential Recommendation (SR) methods play a crucial role in recommender systems, which aims to capture users' dynamic interest from their historical interactions. Recently, Contrastive Learning (CL), which has emerged as a successful method for sequential recommendation, utilizes various data augmentations to generate contrastive views to mine supervised signals from data to alleviate data sparsity issues. However, most existing sequential data augmentation methods may destroy semantic sequential interaction characteristics. Meanwhile, they often adopt random operations when generating contrastive views leading to suboptimal performance. To this end, in this paper, we propose a Learnable Model Augmentation Contrastive learning for sequential Recommendation (LMA4Rec). Specifically, LMA4Rec first takes the model-based augmentation method to generate constructive views. Then, LMA4Rec uses Learnable Bernoulli Dropout (LBD) to implement learnable model augmentation operations. Next, contrastive learning is used between the contrastive views to extract supervised signals. Furthermore, a novel multi-positive contrastive learning loss alleviates the supervised sparsity issue. Finally, experiments on public datasets show that our LMA4Rec method effectively improved sequential recommendation performance compared with the state-of-the-art baseline methods.

Original languageEnglish
Pages (from-to)3963-3976
Number of pages14
JournalIEEE Transactions on Knowledge and Data Engineering
Volume36
Issue number8
DOIs
Publication statusPublished - Aug 2024

Keywords

  • contrastive learning
  • learnable dropout
  • model augmentation
  • multi-positive pairs
  • sequential recommendation

Fingerprint

Dive into the research topics of 'Learnable model augmentation contrastive learning for sequential recommendation'. Together they form a unique fingerprint.

Cite this