基于Hadoop的IPTV隐式评分模型

doi:10.11772/j.issn.1001-9081.2017.11.3188

计算机应用 ›› 2017, Vol. 37 ›› Issue (11): 3188-3193.DOI: 10.11772/j.issn.1001-9081.2017.11.3188

• 第十六届中国机器学习会议(CCML 2017) • 上一篇下一篇

基于Hadoop的IPTV隐式评分模型

顾军华¹, 官磊¹, 张建¹, 高星¹, 张素琪²

1. 河北工业大学计算机科学与软件学院, 天津 300401;
2. 天津商业大学信息工程学院, 天津 300134

收稿日期:2017-05-16 修回日期:2017-07-05 出版日期:2017-11-10 发布日期:2017-11-11
通讯作者: 顾军华
作者简介:顾军华(1966-),男,河北赵县人,教授,博士,CCF会员,主要研究方向:数据挖掘、智能信息处理、信息采集与集成、智能计算与优化、软件工程;官磊(1992-),男,河南信阳人,硕士研究生,主要研究方向:智能信息处理;张建(1993-),男,河北涿州人,硕士研究生,主要研究方向:数据挖掘;高星(1992-),女,河北赵县人,硕士研究生,主要研究方向:商务智能、软计算;张素琪(1980-),女,河北隆尧人,讲师,博士,CCF会员,主要研究方向:数据挖掘。
基金资助:
天津市自然科学基金资助项目（15JCQNJC00600，14JCYBJC15900）。

IPTV implicit scoring model based on Hadoop

GU Junhua¹, GUAN Lei¹, ZHANG Jian¹, GAO Xing¹, ZHANG Suqi²

1. School of Computer Science and Software, Hebei University of Technology, Tianjin 300401, China;
2. School of Information Engineering, Tianjin University of Commerce, Tianjin 300134, China

Received:2017-05-16 Revised:2017-07-05 Online:2017-11-10 Published:2017-11-11
Supported by:
This work is partially supported by the Natural Science Foundation of Tianjin (15JCQNJC00600, 14JCYBJC15900).

摘要/Abstract

摘要： 根据网路协定电视（IPTV）用户收视行为数据中的隐式特性，提出一种新型的隐式评分模型。首先，介绍了IPTV用户收视行为数据的主要特点，提出一种新的用户收视比值、用户兴趣偏置因子以及视频类型影响因子相结合的多特征混合隐式评分模型；然后，提出基于收视时长和收视比值的收视行为筛选策略；最后，设计并实现了基于Hadoop的分布式模型架构。实验结果表明，所提模型有效提高了IPTV系统中推荐结果的质量，同时提升了时间效率，对于大规模数据有良好的可扩展性。

关键词: 隐式反馈, 分布式模型, 兴趣模型, 网路协定电视

Abstract: According to the implicit characteristics of IPTV (Internet Protocol Television) user viewing behavior data, a novel implicit rating model was proposed. Firstly, the main features of IPTV user viewing behavior data were introduced, and a new mixed feature implicit scoring model was proposed, which combined with viewing ratio, user interest bias factor and video type influence factor. Secondly, the strategy of viewing behavior based on viewing time and viewing ratio was proposed. Finally, a distributed model architecture based on Hadoop was designed and implemented. The experimental results show that the proposed novel model effectively improves the quality of the recommended results in the IPTV system, improves the time efficiency, and has good scalability for large amounts of data.

Key words: implicit feedback, distributed model, interest model, Internet Protocol Television (IPTV)

中图分类号:

TP393.08

顾军华, 官磊, 张建, 高星, 张素琪. 基于Hadoop的IPTV隐式评分模型[J]. 计算机应用, 2017, 37(11): 3188-3193.

GU Junhua, GUAN Lei, ZHANG Jian, GAO Xing, ZHANG Suqi. IPTV implicit scoring model based on Hadoop[J]. Journal of Computer Applications, 2017, 37(11): 3188-3193.

参考文献

[1] 郝芸霞,金耀星.国内外三网融合发展现状研究及分析[J].信息通信技术, 2011, 5(3):51-55.(HAO Y X, JIN Y X. Research and analysis of triple play at home and abroad[J]. Information and Communications Technologies, 2011, 5(3):51-55.)
[2] 崔永利.基于隐语义模型的IPTV上下文感知推荐算法[D].上海:华东师范大学,2013.(CUI Y L. Latent factor model based iptv context-aware recommendation algorithms[D]. Shanghai:East China Normal University, 2013.)
[3] JOACHIMS T, GRANKA L, PAN B, et al. Accurately interpreting click through data as implicit feedback[C]//Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. New York:ACM, 2005:154-161.
[4] CLAYPOOL M, LE P, WASEDA M, et al. Implicit interest indicators[C]//Proceedings of the 6th International Conference on Intelligent User Interfaces. New York:ACM, 2001:33-40.
[5] LEUNG W K, CHAN C F, CHUNG F L. An empirical study of a cross-level association rule mining approach to cold-start recommendations[J]. Knowledge-Based Systems, 2008, 21(7):515-529.
[6] POPESCUL A, PENNOCK D M, LAWRENCE S. Probabilistic models for unified collaborative and content-based recommendation in sparse-data environments[C]//Proceedings of the 17th Conference on Uncertainty in Artificial Intelligence. San Francisco, CA:Morgan Kaufmann Publishers Inc, 2001:437-444.
[7] ULUYAGMUR M, CATALTEPE Z, TAYFUR E. Content-based movie recommendation using different feature sets[EB/OL].[2016-11-20]. http://www.iaeng.org/publication/WCECS2012/WCECS2012_pp517-521.pdf.
[8] GADANHO S C, LHUILLIER N. Addressing uncertainty in implicit preferences[C]//Proceedings of the 2007 ACM Conference on Recommender Systems. New York:ACM, 2007:97-104.
[9] OARD D W, KIM J. Modeling information content using observable behavior[EB/OL].[2016-11-20]. http://terpconnect.umd.edu/~oard/pdf/asis01.pdf.
[10] KELLY D, TEEVAN J. Implicit feedback for inferring user preference:a bibliography[J]. ACM SIGIR Forum, 2003, 37(2):18-28.
[11] HU Y, KOREN Y, VOLINSKY C. Collaborative filtering for implicit feedback datasets[C]//Proceedings of the 8th IEEE International Conference on Data Mining. Piscataway, NJ:IEEE, 2008:263-272.
[12] KOREN Y, BELL R, VOLINSKY C. Matrix factorization techniques for recommender systems[J]. Computer, 2009, 42(8):30-37.
[13] ZHENG Y, LIU C, TANG B, et al. Neural autoregressive collaborative filtering for implicit feedback[C]//Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. New York:ACM, 2016:1-6.
[14] GUO W, WU S, WANG L, et al. Personalized ranking with pairwise factorization machines[J]. Neurocomputing, 2016, 214:191-200.
[15] 印鉴,王智圣,李琪, 等.基于大规模隐式反馈的个性化推荐[J].软件学报,2014,25(9):1953-1966. (YIN J, WANG Z S, LI Q, et al. Personalized recommendation based on large-scale implicit feedback[J]. Journal of Software, 2014, 25(9):1953-1966.)
[16] 纪淑娟,王理,梁永全,等.基于神经网络的用户视频评分自动获取方法[J].计算机科学,2015,42(11):96-100.(JI S J, WANG L, LIANG Y Q, et al. Neural-network-based method for automatic acquisiton of user's video rating[J]. Computer Science, 2015,42(11):96-100.)
[17] KIM E, PYO S, PARK E, et al. An automatic recommendation scheme of TV program contents for IPTV personalization[J]. IEEE Transactions on Broadcasting, 2011, 57(3):674-684.
[18] YUE J, GU J, ZHANG S. Spark-based distributed multi-features hybrid IPTV viewing implicit feedback scoring model[C]//Proceedings of the 2016 International Conference on Behavior Engineering. Macau:ISI, 2016:97-104.

基于Hadoop的IPTV隐式评分模型

IPTV implicit scoring model based on Hadoop

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

[1]	张文龙, 钱付兰, 陈洁, 赵姝, 张燕平. 基于双重最相关注意力网络的协同过滤推荐算法[J]. 计算机应用, 2020, 40(12): 3445-3450.
[2]	肖春景, 夏克文, 乔永卫, 张宇翔. 基于动态聚类的旅游线路推荐[J]. 计算机应用, 2017, 37(8): 2395-2400.
[3]	杨武, 唐瑞, 卢玲. 基于内容的推荐与协同过滤融合的新闻推荐方法[J]. 计算机应用, 2016, 36(2): 414-418.
[4]	王东, 陈志, 岳文静, 高翔, 王峰. 基于显式与隐式反馈信息的概率矩阵分解推荐[J]. 计算机应用, 2015, 35(9): 2574-2578.
[5]	李改. 融合显/隐式反馈的协同排序算法[J]. 计算机应用, 2015, 35(5): 1328-1332.
[6]	夏宁霞苏一丹覃华张敏. 社会化标签系统中个性化的用户建模方法[J]. 计算机应用, 2011, 31(06): 1667-1670.
[7]	聂立钟珞. 主动服务中程序挖掘系统框架的设计与实现[J]. 计算机应用, 2009, 29(07): 1767-1770.
[8]	张卫丰，徐宝文. WWW缓冲挖掘中基于粗糙集的用户模糊兴趣建模[J]. 计算机应用, 2005, 25(09): 1992-1994.