Multi-graph neural network-based session perception recommendation model

doi:10.11772/j.issn.1001-9081.2020060805

Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (2): 330-336.DOI: 10.11772/j.issn.1001-9081.2020060805

Special Issue: 人工智能

• Artificial intelligence • Previous Articles Next Articles

Multi-graph neural network-based session perception recommendation model

NAN Ning^1,2, YANG Chengyi^2,3, WU Zhihao^1,2

1. School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, China;
2. Key Laboratory of Intelligent Passenger Service of Civil Aviation, Civil Aviation Administration of China, Beijing 100105, China;
3. China Civil Aviation Information Network Incorporation Limited, Beijing 101318, China

Received:2020-06-15 Revised:2020-09-29 Online:2021-02-10 Published:2020-12-18
Supported by:
This work is partially supported by the Science and Technology Major Project of Civil Aviation Administration of China (MHRD20160109).

基于多图神经网络的会话感知推荐模型

南宁^1,2, 杨程屹^2,3, 武志昊^1,2

1. 北京交通大学计算机与信息技术学院, 北京 100044;
2. 中国民用航空局民航旅客服务智能化应用技术重点实验室, 北京 100105;
3. 中国民航信息网络股份有限公司, 北京 101318

通讯作者: 杨程屹
作者简介:南宁(1995-),男,山东泰安人,硕士研究生,主要研究方向:机器学习、数据挖掘;杨程屹(1986-),河北唐山人,工程师,博士,主要研究方向:人工智能、收益管理、民航智能化;武志昊(1984-),山西大同人,副教授,博士生导师,博士,主要研究方向:数据与知识工程、人工智能。
基金资助:
民航科技重大专项资助项目（MHRD20160109）。

Abstract

Abstract: The session-based recommendation algorithms mainly rely on the information from the target session, but fail to fully utilize the collaborative information from other sessions. In order to solve this problem, a Multi-Graph neural network-based Session Perception recommendation (MGSP) model was proposed. Firstly, according to the target session and all sessions in the training set, Item-Transition Graph (ITG) and Collaborative Relation Graph (CRG) were constructed. Based on these two graphs, the Graph Neural Network (GNN) was applied to aggregate the information of the nodes in order to obtain two types of node representations. Then, after the two-layer attention module modelling two type node representations, the session-level representation was obtained. Finally, by using the attention mechanism to fuse the information, the ultimate session representation was gained, and the next interaction item was predicted. The comparison experiments were carried out in two scenarios of e-commerce and civil aviation. Experimental results show that, the proposed algorithm is superior to the optimal benchmark model, with an increase of more than 1 percentage point and 3 percentage point in the indicators on the e-commerce and civil aviation datasets respectively, verifying the effectiveness of the proposed model.

Key words: session-based recommendation, multi-graph neural network, attention mechanism, personal preference, collaborative information

摘要： 针对基于会话的推荐算法主要依赖目标会话中的信息，而未充分利用其他会话中的协同信息的问题，提出了一种基于多图神经网络的会话感知推荐（MGSP）模型。首先，根据目标会话与训练集中的所有会话构建物品转移图（ITG）和协同关联图（CRG），并基于这两张图应用图神经网络（GNN）来汇聚节点的信息，得到两类的节点表示；然后，经过双层注意力模块对两类节点表示建模，获取会话级别的表示；最后，使用注意力机制进行信息融合，得到最终的会话表示，并预测下一个交互物品。分别在电商和民航两个场景下进行了对比实验，实验结果表明，相较最优的基准模型，MGSP模型在电商数据集各项指标上的提高超过1个百分点，在民航数据集各项指标上的提高约为3个百分点，验证了MGSP模型的有效性。

CLC Number:

TP391.4

NAN Ning, YANG Chengyi, WU Zhihao. Multi-graph neural network-based session perception recommendation model[J]. Journal of Computer Applications, 2021, 41(2): 330-336.

南宁, 杨程屹, 武志昊. 基于多图神经网络的会话感知推荐模型[J]. 计算机应用, 2021, 41(2): 330-336.

References

[1] WOODS D D,PATTERSON E S,ROTH E M. Can we ever escape from data overload? A cognitive systems diagnosis[J]. Cognition, Technology and Work,2002,4(1):22-36.
[2] LUDEWIG M, JANNACH D. Evaluation of session-based recommendation algorithms[J]. User Modeling and User-Adapted Interaction,2018,28(4/5):331-390.
[3] SCHAFER J B, KONSTAN J A, RIEDL J. E-commerce recommendation applications[J]. Data Mining and Knowledge Discovery,2001,5(1/2):115-153.
[4] JAYAWARDANA C,HEWAGAMAGE K P,HIRAKAWA M. A personalized information environment for digital libraries[J]. Information Technology and Libraries,2001,20(4):185-196.
[5] KONSTAN J A,MILLER B N,MALTZ D,et al. GroupLens:applying collaborative filtering to Usenet news[J]. Communications of the ACM,1997,40(3):77-87.
[6] JIA Z,YANG Y,GAO W,et al. User-based collaborative filtering for tourist attraction recommendations[C]//Proceedings of the 2015 IEEE International Conference on Computational Intelligence and Communication Technology. Piscataway:IEEE,2015:22-25.
[7] RENDLE S,FREUDENTHALER C,GANTNER Z,et al. BPR:Bayesian personalized ranking from implicit feedback[C]//Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. Arlington,VA:AUAI,2009:452-461.
[8] SARWAR B, KARYPIS G, KONSTAN J, et al. Item-based collaborative filtering recommendation algorithms[C]//Proceedings of the 2001 International Conference on World Wide Web. New York:ACM,2001:285-295.
[9] KOREN Y, BELL R, VOLINSKY C. Matrix factorization techniques for recommender systems[J]. Computer,2009,42(8):30-37.
[10] RENDLE S, FREUDENTHALER C, SCHMIDT-THIEME L. Factorizing personalized Markov chains for next-basket recommendation[C]//Proceedings of the 19th International Conference on World Wide Web. New York:ACM, 2010:811-820.
[11] HIDASI B,QUADRANA M,KARATZOGLOU A,et al. Parallel recurrent neural network architectures for feature-rich sessionbased recommendations[C]//Proceedings of the 10th ACM Conference on Recommender Systems. New York:ACM,2016:241-248.
[12] JANNACH D,LUDEWIG M. When recurrent neural networks meet the neighborhood for session-based recommendation[C]//Proceedings of the 11th ACM Conference on Recommender Systems. New York:ACM,2017:306-310.
[13] HIDASI B,KARATZOGLOU A,BALTRUNAS L,et al. Sessionbased recommendations with recurrent neural networks[EB/OL].[2020-03-14]. https://arxiv.org/pdf/1511.06939.pdf.
[14] 曾义夫, 牟其林, 周乐, 等. 基于图表示学习的会话感知推荐模型[J]. 计算机研究与发展,2020,57(3):590-603.(ZENG Y F,MU Q L,ZHOU L,et al. Graph embedding based session perception model for next-click recommendation[J]. Journal of Computer Research and Development,2020,57(3):590-603.)
[15] TAN Y K,XU X,LIU Y. Improved recurrent neural networks for session-based recommendations[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. New York:ACM,2016:17-22.
[16] LI J,REN P,CHEN Z,et al. Neural attentive session-based recommendation[C]//Proceedings of the 26th ACM Conference on Information and Knowledge Management. New York:ACM, 2017:1419-1428.
[17] LIU Q,ZENG Y,MOKHOSI R,et al. STAMP:short-term attention/memory priority model for session-based recommendation[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM,2018:1831-1839.
[18] WU S,TANG Y,ZHU Y,et al. Session-based recommendation with graph neural network[C]//Proceedings of the 33rd AAAI International Conference on Artificial Intelligence. Palo Alto,CA:AAAI Press,2019:346-353.
[19] XU C,ZHAO P,LIU Y,et al. Graph contextualized self-attention network for session-based recommendation[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence. Palo Alto,CA:AAAI Press,2019:3940-3946.
[20] LI Y,ZEMEL R,BROCKSCHMIDT M,et al. Gated graph sequence neural networks[EB/OL].[2020-03-14]. https://arxiv.org/pdf/1511.05493.pdf.
[21] VASWANI A,SHAZEER N,PARMAR N,et al. Attention is all you need[C]//Proceedings of 31st International Conference on Neural Information Processing Systems. Red Hook,NY:Curran Associates Inc.,2017:6000-6010.

Multi-graph neural network-based session perception recommendation model

基于多图神经网络的会话感知推荐模型

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[2]	LIU Yaxuan, ZHONG Yong. Joint extraction method of entities and relations based on subject attention [J]. Journal of Computer Applications, 2021, 41(9): 2517-2522.
[3]	LI Kangkang, ZHANG Jing. Multi-layer encoding and decoding model for image captioning based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(9): 2504-2509.
[4]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[5]	DANG Weichao, LI Tao, BAI Shangwang, GAO Gaimei, LIU Chunxia. Real-time remaining life prediction method of Web software system based on self-attention-long short-term memory network [J]. Journal of Computer Applications, 2021, 41(8): 2346-2351.
[6]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.
[7]	LI Chao, LAN Hai, WEI Xian. Attention-based object detection with millimeter wave radar-lidar fusion [J]. Journal of Computer Applications, 2021, 41(7): 2137-2144.
[8]	WU Wei, LI Zeping, YANG Huawei, LIN Chuan, WANG Zhongde. Deep attention video popularity prediction model fusing content features and temporal information [J]. Journal of Computer Applications, 2021, 41(7): 1878-1884.
[9]	LI Yangzhi, YUAN Jiazheng, LIU Hongzhe. Human skeleton-based action recognition algorithm based on spatiotemporal attention graph convolutional network model [J]. Journal of Computer Applications, 2021, 41(7): 1915-1921.
[10]	ZHANG Yang, JIANG Minghu. Authorship identification of text based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(7): 1897-1901.
[11]	LI Xiang, WANG Weibing, SHANG Xueda. Application of Transformer optimized by pointer generator network and coverage loss in field of abstractive text summarization [J]. Journal of Computer Applications, 2021, 41(6): 1647-1651.
[12]	LIU Shize, ZHU Yida, CHEN Runze, LUO Haiyong, ZHAO Fang, SUN Yi, WANG Baohui. Traffic mode recognition algorithm based on residual temporal attention neural network [J]. Journal of Computer Applications, 2021, 41(6): 1557-1565.
[13]	SHEN Xuewen, WANG Xiaodong, YAO Yu. Spatial frequency divided attention network for ultrasound image segmentation [J]. Journal of Computer Applications, 2021, 41(6): 1828-1835.
[14]	LAI Xuemei, TANG Hong, CHEN Hongyu, LI Shanshan. Multimodal sentiment analysis based on feature fusion of attention mechanism-bidirectional gated recurrent unit [J]. Journal of Computer Applications, 2021, 41(5): 1268-1274.
[15]	ZHANG Rong, ZHANG Xianguo. Opinion spam detection based on hierarchical heterogeneous graph attention network [J]. Journal of Computer Applications, 2021, 41(5): 1275-1281.