Point-of-interest recommendation algorithm combing dynamic and static preferences

doi:10.11772/j.issn.1001-9081.2020050677

Abstract

Abstract: Since most existing Point-Of-Interest (POI) recommendation algorithms ignore the complexity of the modeling of the fusion of user dynamic and static preferences, a POI recommendation algorithm called CLSR (Combing Long Short Recommendation) was proposed that combined complex dynamic user preferences and general static user preferences. Firstly, in the process of modeling complex dynamic preferences, a hybrid neural network was designed based on the user's check-in behaviors and the skip behaviors in check-in behaviors to achieve the modeling of complex dynamic interests of the user. Secondly, in the process of general static preference modeling, a high-level attention network was used to learn the complex interactions between the user and POIs. Thirdly, a multi-layer neural network was used to further learn and express the above dynamic preferences and static preferences. Finally, a unified POI recommendation framework was used to integrate the preferences. Experimental results on real datasets show that, compared with FPMC-LR (Factorizing Personalized Markov Chain and Localized Region), PRME (Personalized Ranking Metric Embedding), Rank-GeoFM (Ranking based Geographical Factorization Method) and TMCA (Temporal and Multi-level Context Attention), CLSR has the performance greatly improved, and compared to the optimal TMCA among the comparison methods, the proposed algorithm has the precision, recall and normalized Discounted Cumulative Gain (nDCG) increased by 5.8%, 5.1%, and 7.2% on Foursquare dataset, and 7.3%, 10.2%, and 6.3% on Gowalla dataset. It can be seen that CLSR algorithm can effectively improve the results of POI recommendation.

Key words: Point-Of-Interest (POI), recommendation algorithm, Deep Neural Network (DNN), multi-layer projection, attention network

摘要： 针对大多数现有主流兴趣点（POI）推荐算法忽略了融合用户复杂动态偏好和一般静态偏好建模的复杂性问题，提出一个融合复杂动态用户偏好和一般静态用户偏好的POI推荐算法CLSR。首先，在复杂动态偏好建模过程中，基于用户的签到行为及其中的跳过行为设计一个混合神经网络，实现用户的复杂动态兴趣的建模；其次，在一般静态偏好建模过程中，利用高阶注意力网络学习用户与POI之间复杂的交互关系；然后，利用多层神经网络进一步学习和表示上述动态偏好和静态偏好；最后，基于统一的POI推荐框架对偏好进行整合。在真实数据集上的实验结果表明，与个性化马尔可夫链和用户位置受限的推荐方法FPMC-LR、基于个性化排名度量嵌入的推荐方法PRME、基于排名的地理分解兴趣点推荐方法Rank-GeoFM和基于时间和多级上下文注意力机制的下一个兴趣点推荐方法TMCA相比，CLSR的性能有了较大的提高，该算法的准确率、召回率和归一化折损累计增益（nDCG）和对比方法中较优的TMCA相比，在Foursquare数据集上分别提高了5.8%、5.1%和7.2%，在Gowalla数据集上分别提高了7.3%、10.2%和6.3%，可以有效地改善POI推荐的结果。

关键词: 兴趣点, 推荐算法, 深度神经网络, 多层投影, 注意力网络

CLC Number:

TP311

YANG Li, WANG Shihui, ZHU Bo. Point-of-interest recommendation algorithm combing dynamic and static preferences[J]. Journal of Computer Applications, 2021, 41(2): 398-406.

杨丽, 王时绘, 朱博. 基于动态和静态偏好的兴趣点推荐算法[J]. 计算机应用, 2021, 41(2): 398-406.

References

[1] 邵长城, 陈平华. 融合社交网络和图像内容的兴趣点推荐[J]. 计算机应用,2019,39(5):1261-1268.(SHAO C C,CHEN P H. Point-of-interest recommendation integrating social networks and image contents[J]. Journal of Computer Application,2019,39(5):1261-1268.)
[2] 孟祥武, 梁弼, 杜雨露, 等. 基于位置的移动推荐系统效用评价研究[J]. 计算机学报,2019,42(12):2695-2721.(MENG X W, LIANG B,DU Y L,et al. A survey of evaluation for location-based mobile recommender systems[J]. Chinese Journal of Computers, 2019,42(12):2695-2721.)
[3] LIU Q,WU S,WANG L,et al. Predicting the next location:a recurrent model with spatial and temporal contexts[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2016:194-200.
[4] LI R,SHEN Y,ZHU Y. Next point-of-interest recommendation with temporal and multi-level context attention[C]//Proceedings of the 2018 IEEE International Conference on Data Mining. Piscataway:IEEE,2018:1110-1115.
[5] WANG S, HU L, WANG Y, et al. Sequential recommender systems challenges,progress and prospects[C]//Proceedings of the 28th International Joint Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2019:6332-6338.
[6] QUADRANA M, KARATZOGLOU A, HIDASI B, et al. Personalizing session-based recommendations with hierarchical recurrent neural networks[C]//Proceedings of the 11th ACM Conference on Recommender Systems. New York:ACM,2017:130-137.
[7] TANG J,WANG K. Personalized top-N sequential recommendation via convolutional sequence embedding[C]//Proceedings of the 11th ACM International Conference on Web Search and Data Mining. New York:ACM,2018:565-573.
[8] SUN P, WU L, WANG M. Attentive recurrent social recommendation[C]//Proceedings of the 41st ACM International SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2018:185-194.
[9] SACHDEVA N,GUPTA K,PUDI V. Attentive neural architecture incorporating song features for music recommendation[C]//Proceedings of the 12th ACM Conference on Recommender Systems. New York:ACM,2018:417-421.
[10] YUN S,KIM R,KO M,et al. SAIN:self-attentive integration network for recommendation[C]//Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2019:1205-1208.
[11] WU C Y,AHMED A,BEUTEL A,et al. Recurrent recommender networks[C]//Proceedings of the 10th ACM International Conference on Web Search and Data Mining. New York:ACM, 2017:495-503.
[12] 冯永, 张备, 强保华, 等. MN-HDRM:长短兴趣多神经网络混合动态推荐模型[J]. 计算机学报,2019,42(1):16-28.(FENG Y,ZHANG B,QIANG B H,et al. MN-HDRM:a novel hybrid dynamic recommendation model based on long-short-term interests multiple neural network[J]. Chinese Journal of Computers,2019, 42(1):16-28.)
[13] 张青博, 王斌, 崔宁宁, 等. 基于注意力机制的规范化矩阵分解推荐算法[J]. 软件学报,2020,31(3):778-793.(ZHANG Q B, WANG B,CUI N N,et al. Attention-based regularized matrix factorization for recommendation[J]. Journal of Software,2020, 31(3):778-793.)
[14] CHENG C,YANG H,LYU M R,et al. Where you like to go next:successive point-of-interest recommendation[C]//Proceedings of the 23rd International Joint Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2013:2605-2611.
[15] ZHAO S,ZHAO T,YANG H,et al. STELLAR:spatial-temporal latent ranking for successive point-of-interest recommendation[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2016:315-321.
[16] XIE M,YIN H,WANG H,et al. Learning graph-based POI embedding for location-based recommendation[C]//Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. New York:ACM,2016:15-24.
[17] ITTI L,KOCH C,NIEBUR E. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[18] CHEN B,DENG W,HU J. Mixed high-order attention network for person re-identification[C]//Proceeding of the 2019 IEEE/CVF International Conference on Computer Vision. Piscataway:IEEE, 2019:371-381.
[19] LIU L,FINCH A,UTIYAMA M,et al. Agreement on targetbidirectional LSTMs for sequence-to-sequence learning[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2016:2630-2637.
[20] XIAO J,YE H,HE X,et al. Attentional factorization machines learning the weight of feature interactions via attention networks[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2017:3119-3125.
[21] ZHOU M,DING Z,TANG J,et al. Micro behaviors:a new perspective in e-commerce recommender systems[C]//Proceedings of the 11th ACM International Conference on Web Search and Data Mining. New York:ACM,2018:727-735.
[22] CHEN J, ZHANG H, HE X, et al. Attentive collaborative filtering:Multimedia recommendation with item-and componentlevel attention[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2017:335-344.
[23] YING H,ZHUANG F,ZHANG F,et al. Sequential recommender system based on hierarchical attention networks[C]//Proceedings of the 26th International Joint Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2018:3926-3932.
[24] CHEN C,ZHANG M,LIU Y,et al. Neural attentional rating regression with review-level explanations[C]//Proceeding of 27th International World Wide Web Conference. Republic and Canton of Geneva:International World Wide Web Conferences Steering Committee,2018:1583-1592.
[25] TAY Y,LUU A T,HUI S C. Multi-pointer co-attention networks for recommendation[C]//Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM,2018:2309-2318.
[26] KINGMA D P, BA J L. Adam:a method for stochastic optimization[EB/OL].[2020-03-04]. https://arxiv.org/pdf/1412.6980.pdf.
[27] GAO H, TANG J, LIU H. gSCorr:modeling geo-social correlations for new check-ins on location-based social networks[C]//Proceedings of the 21st ACM International Conference on Information and Knowledge Management. New York:ACM, 2012:1582-1586.
[28] CHO E,MYERS S A,LESKOVEC J. Friendship and mobility:user movement in location-based social networks[C]//Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM,2011:1082-1090.
[29] HIDASI B,KARATZOGLOU A. Recurrent neural networks with top-k gains for session-based recommendations[C]//Proceedings of the 27th ACM International Conference on Information and Knowledge Management. New York:ACM,2018:843-852.
[30] HE R,MCAULEY J. Fusing similarity models with Markov chains for sparse sequential recommendation[C]//Proceedings of the IEEE 16th International Conference on Data Mining. Piscataway:IEEE,2016:191-200.
[31] FENG S,LI X,ZENG Y,et al. Personalized ranking metric embedding for next new POI recommendation[C]//Proceedings of the 24th International Joint Conference on Artificial Intelligence. Menlo Park,CA:AAAI Press,2015:2069-2075.
[32] LI X,CONG G,LI X L,et al. Rank-GeoFM:a ranking based geographical factorization method for Point-of-interest recommendation[C]//Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2015:433-442.
[33] HE X,CHUA T S. Neural factorization machines for sparse predictive analytics[C]//Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2017:355-364.