《计算机应用》唯一官方网站

• •    下一篇

结合自我特征和对比学习的推荐模型

杨兴耀1陈羽1于炯1张祖莲2陈嘉颖1王东晓1   

  1. 1. 新疆大学 软件学院 2. 新疆维吾尔自治区气象局 新疆兴农网信息中心
  • 收稿日期:2023-09-14 修回日期:2023-10-26 发布日期:2023-11-23 出版日期:2023-11-23
  • 通讯作者: 杨兴耀
  • 作者简介:杨兴耀(1984—),男,湖北襄阳人,副教授,博士,CCF会员,主要研究方向:推荐系统、大数据、信任计算;陈羽(2000—),男,湖南岳阳人,硕士研究生,主要研究方向:推荐系统;于炯(1964—),男,新疆乌鲁木齐人,教授,博士,CCF会员,主要研究方向:网格计算、并行计算;张祖莲(1984—),女,湖北襄阳人,高级工程师,硕士,主要研究方向:数值预报、信息检索;陈嘉颖(1988—),女,新疆沙湾人,副教授,博士,CCF会员,主要研究方向:推荐系统、社交网络、数据挖掘;王东晓(1970—),男,黑龙江绥化人,实验师,主要研究方向:网络安全。
  • 基金资助:
    新疆维吾尔自治区自然科学基金面上项目(2023D01C17);国家自然科学基金资助项目(62262064,61862060);新疆维吾尔自治区自然科学基金资助项目(2022D01C692);新疆维吾尔自治区自然科学基金资源共享平台建设项目(PT2323);新疆气象局引导项目(YD202212);劳务派遣管理信息化系统(202212140030)

Recommendation model combining self-features and contrastive learning

YANG Xingyao1, CHEN Yu1, YU Jiong1, ZHANG Zulian2, CHEN Jiaying1, WANG Dongxiao1   

  1. 1. School of Software, Xinjiang University 2. Xinjiang Xinnong Network Information Center, Meteorological Bureau of Xinjiang Uygur Autonomous Region
  • Received:2023-09-14 Revised:2023-10-26 Online:2023-11-23 Published:2023-11-23
  • Contact: Xing-Yao YANG
  • About author:YANG Xingyao, born in 1984, Ph. D., associate professor. His research interests include recommender system, big data, trust computation. CHEN Yu, born in 2000, M. S. candidate. His research interests include recommender system. YU Jiong, born in 1964, Ph. D., professor. His research interests include grid computing, parallel computing. ZHANG Zulian, born in 1984, M. S., senior engineer. Her research interests include numerical prediction, information retrieval. CHEN Jiaying, born in 1988, Ph. D., associate professor. Her research interests include recommender system, social network, data mining. WANG Dongxiao, born in 1970, experimentalist. His research interests include cyber security.
  • Supported by:
    Xinjiang Uygur Autonomous Region Natural Science Foundation General Project (2023D01C17), National Natural Science Foundation of China (62262064, 61862060),Xinjiang Uygur Autonomous Region Natural Science Foundation General Project (2022D01C692), Xinjiang Uygur Autonomous Region Natural Science Foundation Resource Sharing Platform Construction Project (PT2323), Xinjiang Meteorological Bureau Guidance Project (YD202212) , Labor Dispatch Management Information System (202212140030).

摘要: 针对图神经网络推荐中图卷积在消息传递过程存在嵌入表示过平滑和噪声问题,提出一种结合自我特征和对比学习的推荐模型(SfCLRec)。采用预训练-正式训练架构训练模型,首先预训练用户和项目的嵌入表示,通过融合节点自我特征维持节点本身的特征唯一性,并引入层级对比学习任务缓解来自高阶邻居节点中的噪声信息;然后,在正式训练阶段根据评分机制重新构建协同图邻接矩阵;最后,根据最终嵌入得到预测评分。实验结果表明,相较于LightGCN、SimGCL等现有图神经网络推荐模型,SfCLRec在三个公开数据集ML-latest-small、Last.FM和Yelp中均取得了较好的召回率和归一化折损累计增益(NDCG),验证了模型的有效性。

关键词: 图协同过滤, 过平滑, 自我特征, 对比学习, 图神经网络, 个性化推荐

Abstract: Aiming at the problems of over-smoothing and noise in the embedding representation in the message passing process of graph convolution based on graph neural network recommendation, a Recommendation model combining Self-features and Contrastive Learning (SfCLRec) were proposed. The model was trained using a pre-training-formal training architecture. Firstly, the embedding representation of users and items was pretrained to maintain the feature uniqueness of the nodes themselves by fusing the node self-features and introducing a hierarchical contrastive learning task to mitigate the noisy information from the higher-order neighboring nodes. Then, the collaborative graph adjacency matrix was reconstructed according to the scoring mechanism in the formal training stage. Finally, the predicted score was obtained based on the final embedding. Compared with existing graph neural network recommendation models such as LightGCN and SimGCL, SfCLRec achieves the better recall and NDCG (Normalized Discounted Cumulative Gain) in three public datasets ML-latest-small, Last.FM and Yelp, validating the effectiveness of the model.

Key words: graph collaborative filtering, over-smoothing, self-feature, contrastive learning, graph neural network, personalized recommendations

中图分类号: