Hybrid recommendation algorithm by fusion of topic information and convolution neural network

doi:10.11772/j.issn.1001-9081.2019122067

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (7): 1901-1907.DOI: 10.11772/j.issn.1001-9081.2019122067

• Artificial intelligence • Previous Articles Next Articles

Hybrid recommendation algorithm by fusion of topic information and convolution neural network

TIAN Baojun¹, LIU Shuang², FANG Jiandong¹

1. College of Information Engineering, Inner Mongolia University of Technology, Hohhot Inner Mongolia 010080, China;
2. College of Data Science and Application, Inner Mongolia University of Technology, Hohhot Inner Mongolia 010080, China

Received:2019-12-09 Revised:2020-02-17 Online:2020-07-10 Published:2020-05-14
Supported by:
This work is partially supported by the Natural Science Foundation of Inner Mongolia Autonomous Region (2019MS06024, 2019MS06023), the Science and Technology Major Project of Inner Mongolia Autonomous Region (2018ZD0302), the Science and Technology Program of Inner Mongolia Autonomous Region (20170306).

融合主题信息和卷积神经网络的混合推荐算法

田保军¹, 刘爽², 房建东¹

1. 内蒙古工业大学信息工程学院, 呼和浩特 010080;
2. 内蒙古工业大学数据科学与应用学院, 呼和浩特 010080

通讯作者: 田保军
作者简介:田保军(1971-),男,内蒙古呼和浩特人,副教授,硕士,主要研究方向:机器学习、推荐系统;刘爽(1993-),女,山东菏泽人,硕士研究生,主要研究方向:推荐系统;房建东(1966-),女,内蒙古呼和浩特人,教授,博士,主要研究方向:信息处理、智能控制。
基金资助:
内蒙古自治区自然科学基金资助项目（2019MS06024，2019MS06023）；内蒙古自治区科技重大项目（2018ZD0302）；内蒙古自治区科技计划项目（20170306）。

Abstract

Abstract: Aiming at the problems of data sparsity and inaccuracy of recommendation results in the traditional collaborative filtering algorithms, a Probability Matrix Factorization recommendation model based on Latent Dirichlet Allocations (LDA) and Convolutional Neural Network (CNN) named LCPMF was proposed, which considers the topic information and deep semantic information of project review document comprehensively. Firstly, the LDA topic model and the text CNN were used to model the project review document respectively. Then, the significant potential low-dimensional topic information and the global deep semantic information of project review document were obtained in order to capture the multi-level feature representation of the project document. Finally, the obtained features of users and multi-level projects were integrated into the Probability Matrix Factorization (PMF) model to generate the prediction score for recommendation. LCPMF was compared with the classical PMF, Collaborative Deep Learning (CDL) and Convolutional Matrix Factorization (ConvMF) models on the real datasets Movielens 1M, Movielens 10M and Amazon. The experimental results show that, compared to PMF, CDL and ConvMF models, on the Movielens 1M dataset, the Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) of the proposed recommender model LCPMF are reduced by 6. 03% and 5.38%, 5.12% and 4.03%, 1.46% and 2.00% respectively; on the Movielens 10M dataset, the RMSE and MAE of LCPMF are reduced by 5.35% and 5.67%, 2.50% and 3.64%, 1.75% and 1.74% respectively; while on the Amazon dataset, the RMSE and MAE of LCPMF are reduced by 17.71% and 23.63%, 14.92% and 17.47%, 3.51% and 4.87% respectively. The feasibility and effectiveness of the proposed model in the recommendation system are verified.

Key words: recommendation algorithm, topic model, Convolutional Neural Network (CNN), Probability Matrix Factorization (PMF), collaborative filtering

摘要： 针对传统的协同过滤算法中数据稀疏和推荐结果不准确的问题，提出了一种基于隐狄利克雷分布（LDA）与卷积神经网络（CNN）的概率矩阵分解推荐模型（LCPMF），该模型综合考虑项目评论文档的主题信息与深层语义信息。首先，分别使用LDA主题模型和文本CNN对项目评论文档建模；然后，获取项目评论文档的显著潜在低维主题信息及全局深层语义信息，从而捕获项目文档的多层次特征表示；最后，将得到的用户和多层次的项目特征融合到概率矩阵分解（PMF）模型中，产生预测评分进行推荐。在真实数据集Movielens 1M、Movielens 10M与Amazon上，将LCPMF与经典的PMF、协同深度学习（CDL）、卷积矩阵因子分解模型（ConvMF）模型进行对比。实验结果表明，相较PMF、CDL、ConvMF模型，所提推荐模型LCPMF的均方根误差（RMSE）和平均绝对误差（MAE）在Movielens 1M数据集上分别降低了6.03%和5.38%、5.12%和4.03%、1.46%和2.00%，在Movielens 10M数据集上分别降低了5.35%和5.67%、2.50%和3.64%、1.75%和1.74%，在Amazon数据集上分别降低17.71%和23.63%、14.92%和17.47%、3.51%和4.87%，验证了所提模型在推荐系统中的可行性与有效性。

CLC Number:

TP183

TIAN Baojun, LIU Shuang, FANG Jiandong. Hybrid recommendation algorithm by fusion of topic information and convolution neural network[J]. Journal of Computer Applications, 2020, 40(7): 1901-1907.

田保军, 刘爽, 房建东. 融合主题信息和卷积神经网络的混合推荐算法[J]. 计算机应用, 2020, 40(7): 1901-1907.

References

[1] BOBADILLA J,ORTEGA F,HERMANDO A,et al. Recommender systems survey[J]. Knowledge-Based Systems, 2013, 46:109-132.
[2] KARABADJI N E I,BELDJOUDI S,SERIDI H,et al. Improving memory-based user collaborative filtering with evolutionary multi-objective optimization[J]. Expert Systems with Applications,2018, 98:153-165.
[3] SHU J,SHEN X,LIU H,et al. A content-based recommendation algorithm for learning resources[J]. Multimedia Systems,2018, 24(2):163-173.
[4] 田保军, 杨浒昀, 房建东. 融合信任和基于概率矩阵分解的推荐算法[J]. 计算机应用, 2019, 39(10):2834-2840.(TIAN B J, YANG H Y,FANG J D. Recommendation algorithm based on probability matrix factorization and fusing trust[J]. Journal of Computer Applications,2019,39(10):2834-2840.)
[5] FENG Y,ZHOU P,WU D,et al. Accurate content push for content-centric social networks:a big data support online learning approach[J]. IEEE Transactions on Emerging Topics in Computational Intelligence,2018,2(6):426-438.
[6] JAYALAKSHMI N,PADMAIA P,SUMA G J. Webpage recommendation system using interesting subgraphs and Laplace based knearest neighbor[J]. International Journal of Pattern Recognition and Artificial Intelligence,2020,34(3):Article No. 2053003.
[7] HWANA S Y,WEI C P,LEE C H,et al. Coauthorship networkbased literature recommendation with topic model[J]. Online Information Review,2017,41(3):318-336.
[8] YUAN W,YANG Y,BAO X. Learning item/user vectors from comments for collaborative recommendation[C]//Proceedings of the 9th International Conference on Machine Learning and Computing. New York:ACM,2017:86-91.
[9] HUO H,LIU X,ZHENG D,et al. Collaborative filtering fusing label features based on SDAE[C]//Proceedings of the 17th Industrial Conference on Data Mining,LNCS 10357. Cham:Springer,2017:223-236.
[10] 黄立威, 江碧涛, 吕守业, 等. 基于深度学习的推荐系统研究综述[J]. 计算机学报, 2018, 41(7):1619-1647.(HUANG L W, JIANG B T,LYU S Y,et al. Survey on deep learning based recommender systems[J]. Chinese Journal of Computers,2018,41(7):1619-1647.)
[11] KIM D,PARK C,OH J,et al. Convolutional matrix factorization for document context-aware recommendation[C]//Proceedings of the 10th ACM Conference on Recommender Systems. New York:ACM,2016:233-240.
[12] LIU J,WANG Y,YAN F. An improved collaborative filtering recommendation algorithm[J]. Computer and Modernization,2017, 32(9):204-208.
[13] 张敏, 丁弼原, 马为之, 等. 基于深度学习加强的混合推荐方法[J]. 清华大学学报(自然科学版), 2017, 57(10):1014-1021. (ZHANG M,DING B Y,MA W Z,et al. Hybrid recommendation approach enhanced by deep learning[J]. Journal of Tsinghua University(Science and Technology),2017,57(10):1014-1021.)
[14] HYUN D,PARK C,YANG M C,et al. Review sentiment-guided scalable deep recommender system[C]//Proceedings of the 41st International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM,2018:965-968.
[15] CHEN W,CAI F,CHEN H,et al. Joint neural collaborative filtering for recommender systems[J]. ACM Transactions on Information Systems,2019,37(4):Article No. 39.
[16] ESKANDANIAN F,SONBOLI N,MOBASHER B. Power of the few:analyzing the impact of influential users in collaborative recommender systems[C]//Proceedings of the 27th ACM Conference on User Modeling,Adaptation and Personalization. New York:ACM,2019:225-233.
[17] 程磊, 高茂庭. 结合时间加权和LDA聚类的混合推荐算法[J]. 计算机工程与应用, 2019, 55(11):160-166.(CHENG L,GAO M T. Hybrid recommendation algorithm based on time weighted and LDA clustering[J]. Computer Engineering and Applications, 2019,55(11):160-166.)
[18] AL-SAFFAR A A M,TAO H,TALAB M A. Review of deep convolution neural network in image classification[C]//Proceedings of the 2017 International Conference on Radar,Antenna,Microwave,Electronics,and Telecommunications. Piscataway:IEEE, 2017:26-31.
[19] WANG W,GANG J. Application of convolutional neural network in natural language processing[C]//Proceedings of the 2018 International Conference on Information Systems and Computer Aided Education. Piscataway:IEEE,2018:64-70.
[20] CHUAN C H,AGRES K,HERREMANS D. From context to concept:exploring semantic relationships in music with word2vec[J]. Neural Computing and Applications, 2020, 32(6):1023-1036.

Hybrid recommendation algorithm by fusion of topic information and convolution neural network

融合主题信息和卷积神经网络的混合推荐算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	SONG Zhongshan, LIANG Jiarui, ZHENG Lu, LIU Zhenyu, TIE Jun. Remote sensing scene classification based on bidirectional gated scale feature fusion [J]. Journal of Computer Applications, 2021, 41(9): 2726-2735.
[2]	LI Kangkang, ZHANG Jing. Multi-layer encoding and decoding model for image captioning based on attention mechanism [J]. Journal of Computer Applications, 2021, 41(9): 2504-2509.
[3]	ZHANG Yongbin, CHANG Wenxin, SUN Lianshan, ZHANG Hang. Detection method of domains generated by dictionary-based domain generation algorithm [J]. Journal of Computer Applications, 2021, 41(9): 2609-2614.
[4]	ZHAO Hong, KONG Dongyi. Chinese description of image content based on fusion of image feature attention and adaptive attention [J]. Journal of Computer Applications, 2021, 41(9): 2496-2503.
[5]	XU Jianglang, LI Linyan, WAN Xinjun, HU Fuyuan. Indoor scene recognition method combined with object detection [J]. Journal of Computer Applications, 2021, 41(9): 2720-2725.
[6]	WANG Hebing, ZHANG Chunmei. Facial landmark detection based on ResNeXt with asymmetric convolution and squeeze excitation [J]. Journal of Computer Applications, 2021, 41(9): 2741-2747.
[7]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[8]	QIN Binbin, PENG Liangkang, LU Xiangming, QIAN Jiangbo. Research progress on driver distracted driving detection [J]. Journal of Computer Applications, 2021, 41(8): 2330-2337.
[9]	HUANG Chengcheng, DONG Xiaoxiao, LI Zhao. Deep pipeline 5×5 convolution method based on two-dimensional Winograd algorithm [J]. Journal of Computer Applications, 2021, 41(8): 2258-2264.
[10]	ZENG Xiangyin, ZHENG Bochuan, LIU Dan. Detection of left and right railway tracks based on deep convolutional neural network and clustering [J]. Journal of Computer Applications, 2021, 41(8): 2324-2329.
[11]	BAO Xuan, CHEN Hongmei, XIAO Qing. Time-incorporated point-of-interest collaborative recommendation algorithm [J]. Journal of Computer Applications, 2021, 41(8): 2406-2411.
[12]	YANG Su, OUYANG Zhi, DU Nisuo. Unsupervised parallel hash image retrieval based on correlation distance [J]. Journal of Computer Applications, 2021, 41(7): 1902-1907.
[13]	TAN Daoqiang, ZENG Cheng, QIAO Jinxia, ZHANG Jun. Shadow detection method based on hybrid attention model [J]. Journal of Computer Applications, 2021, 41(7): 2076-2081.
[14]	WU Guangli, LI Leiting, GUO Zhenzhou, WANG Chengxiang. Video summarization generation model based on improved bi-directional long short-term memory network [J]. Journal of Computer Applications, 2021, 41(7): 1908-1914.
[15]	GAO Qinquan, HUANG Bingcheng, LIU Wenzhe, TONG Tong. Bamboo strip surface defect detection method based on improved CenterNet [J]. Journal of Computer Applications, 2021, 41(7): 1933-1938.