Simulation generating algorithm of Web log based on user interest migration

doi:10.11772/j.issn.1001-9081.2016.12.3476

Journal of Computer Applications ›› 2016, Vol. 36 ›› Issue (12): 3476-3480.DOI: 10.11772/j.issn.1001-9081.2016.12.3476

Previous Articles Next Articles

Simulation generating algorithm of Web log based on user interest migration

PENG Xingxiong^1,2, XIAO Ruliang^1,2

1. Faculty of Software, Fujian Normal University, Fuzhou Fujian 350117, China;
2. Fujian Provincial Engineering Research Center of Public Service Big Data Analysis and Application, Fuzhou Fujian 350117, China

Received:2016-04-23 Revised:2016-06-23 Online:2016-12-10 Published:2016-12-08
Supported by:
This work is partially supported by the Fuijian Provincial Great Plan Project (2016H6007).

基于用户兴趣迁移的Web日志仿真生成算法

彭行雄^1,2, 肖如良^1,2

1. 福建师范大学软件学院, 福州 350117;
2. 福建省公共服务大数据挖掘与应用工程研究中心, 福州 350117

通讯作者: 肖如良
作者简介:彭行雄(1991-),男,湖北孝感人,硕士研究生,主要研究方向:机器学习;肖如良(1966-),男,湖南娄底人,教授,博士,CCF高级会员,主要研究方向:软件工程、大数据软件。
基金资助:
福建省高校产学合作项目（2016H6007）。

Abstract

Abstract: When the existing simulation generation algorithm uses the distribution of the static model to generate a Web log, there is a big difference with real data. In order to solve the problem, a new algorithm of Web Log Simulation Generation based on user interest migration (WLSG) was proposed. Firstly, the relationship between Web log and time was modeled. Secondly, the migration of user interest was simulated when the user accessed to the file in different time. Finally, it was also simulated that the user adaptively access to the file which he was most interested in at the current moment. Compared with the distribution of the existing static model, the proposed algorithm had significantly improved the self-similarity by about 2.86% on average. The experimental results show that, the proposed algorithm can well simulate Web log by user interest in migration to change user access sequence, which is capable of being effectively applied in the Web log simulation generation.

Key words: interest migration, time series, log analysis, self-similarity, simulation generation

摘要： 针对仿真生成算法采用静态分布模型生成Web日志，会造成与真实数据之间存在较大差异的问题，提出一种基于用户兴趣迁移的Web日志仿真生成（WLSG）算法。该算法首先对Web日志与时间的关系进行了建模；其次，模拟了用户在不同时间访问文件时用户的兴趣迁移；最后，也模拟了用户自适应访问当前时刻最感兴趣的文件。相对于现有的采用静态分布模型的仿真算法，所提算法能够提高自相似性指标约2.86%。实验结果表明，该算法通过用户的兴趣迁移来改变用户的访问序列，能够较好地模拟真实Web日志，有效地应用于Web日志的仿真生成。

关键词: 兴趣迁移, 时间序列, 日志分析, 自相似, 仿真生成

CLC Number:

TP311

PENG Xingxiong, XIAO Ruliang. Simulation generating algorithm of Web log based on user interest migration[J]. Journal of Computer Applications, 2016, 36(12): 3476-3480.

彭行雄, 肖如良. 基于用户兴趣迁移的Web日志仿真生成算法[J]. 计算机应用, 2016, 36(12): 3476-3480.

References

[1] MING Z, LUO C, GAO W, et al. BDGS:a scalable big data generator suite in big data benchmarking[C]//Proceedings of the 2013 Workshop Series on Big Data Benchmarking. Berlin:Springer, 2014:138-154.
[2] BUSARI M, WILLIAMSON C. ProWGen:a synthetic workload generation tool for simulation evaluation of Web proxy caches[J]. Computer Networks, 2002, 38(6):779-794.
[3] SARLA P, DOODIPALA M R, DINGARI M. Self similarity analysis of Web users arrival pattern at selected Web centers[J]. American Journal of Computational Mathematics, 2016, 6(1):17-22.
[4] NAHUM E M. Deconstructing SPECweb99[EB/OL].[2016-02-20]. http://www.cs.columbia.edu/~nahum/papers/wcw02-specweb.pdf.
[5] TAY Y C, DAI B T, WANG D T, et al. UpSizeR:synthetically scaling an empirical relational database[J]. Information Systems, 2011, 38(8):1168-1183.
[6] COOPER B F, SILBERSTEIN A, TAM E, et al. Benchmarking cloud serving systems with YCSB[C]//Proceedings of the 2010 ACM Symposium on Cloud Computing. New York:ACM, 2010:143-154.
[7] GU L, ZHOU M, ZHANG Z, et al. Chronos:an elastic parallel framework for stream benchmark generation and simulation[C]//Proceedings of the 2015 IEEE International Conference on Data Engineering. Piscataway, NJ:IEEE, 2015:101-112.
[8] RABL T, POESS M, DANISCH M, et al. Rapid development of data generators using meta generators in PDGF[C]//Proceedings of the 6th International Workshop on Testing Database Systems. New York:ACM, 2013:1-6. [9] GUO L, TAN E, CHEN S, et al. The stretched exponential distribution of Internet media access patterns[C]//Proceedings of the 27th ACM Symposium on Principles of Distributed Computing. New York:ACM, 2008:283-294.
[9] GUO L,TAN E,CHEN S,et al.The stretched exponential distribution of Internet media access patterns[C]//Proceedings of the 27th ACM Symposium on Principles of Distributed Computing.New York:ACM,2008:283-294.
[10] CALZAROSSA M C,MASSARI L,TESSERA D.Workload characterization:a survey revisited[J].ACM Computing Surveys,2016,48(3):1-43.
[11] SHAKER A,LUGHOFER E.Self-adaptive and local strategies for a smooth treatment of drifts in data streams[J].Evolving Systems,2014,5(4):239-257.
[12] KARAGIANNIS T,FALOUTSOS M.SELFIS:a tool for self-similarity and long-range dependence analysis[EB/OL].[2016-02-20]https://www.microsoft.com/en-us/research/wp-content/uploads/2016/02/kdd02.pdf.ComputerCommunicationReview,2003,33(3):8193.
[13] ARLITT M F,WILLIAMSON C L.Web server workload characterization:the search for invariants[J].ACM SIGMETRICS Performance Evaluation Review,1996,24(1):126-137.
[14] PAXSON V,FLOYD S.Wide area traffic:the failure of poisson modeling[J].IEEE/ACM Transactions on Networking,1995,3(3):226-244.
[15] 彭行雄,肖如良,张桂刚.基于自适应提升的概率矩阵分解算法[J].计算机应用,2015,35(12):3497-3501.(PENG X X,XIAO R L,ZHANG G G.Probabilistic matrix factorization algorithm based on AdaBoost[J].Journal of Computer Applications,2015,35(12):3497-3501.)

Simulation generating algorithm of Web log based on user interest migration

基于用户兴趣迁移的Web日志仿真生成算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	LI Yangying, CHEN Zhijun, ZHANG Zihao, YOU Lan. Raw sugar demand forecasting model for sugar manufacturing enterprise based on modified Elman neural network [J]. Journal of Computer Applications, 2021, 41(7): 2113-2120.
[2]	YAO Jie, CHENG Chunling, HAN Jing, LIU Zheng. Anomaly detection method based on multi-task temporal convolutional network in cloud workflow [J]. Journal of Computer Applications, 2021, 41(6): 1701-1708.
[3]	LI Guorong, YE Jimin, ZHEN Yuanting. Time series clustering based on new robust similarity measure [J]. Journal of Computer Applications, 2021, 41(5): 1343-1347.
[4]	CAO Yang, YAN Qiuyan, WU Xin. Ensemble classification algorithm for imbalanced time series [J]. Journal of Computer Applications, 2021, 41(3): 651-656.
[5]	ZHANG Lingzhe, HUANG Xiangdong, QIAO Jialin, GOU Wangminhao, WANG Jianmin. Two-stage file compaction framework by log-structured merge-tree for time series data [J]. Journal of Computer Applications, 2021, 41(3): 618-622.
[6]	MA Tingting, JI Tianjiao, YANG Guanyu, CHEN Yang, XU Wenbo, LIU Hongtu. Incidence trend prediction of hand-foot-mouth disease based on long short-term memory neural network [J]. Journal of Computer Applications, 2021, 41(1): 265-269.
[7]	QIAN Bin, ZHENG Kaihong, CHEN Zipeng, XIAO Yong, LI Sen, YE Chunzhuang, MA Qianli. Time series imputation model based on long-short term memory network with residual connection [J]. Journal of Computer Applications, 2021, 41(1): 243-248.
[8]	XIAO Yong, ZHENG Kaihong, ZHENG Zhenjing, QIAN Bin, LI Sen, MA Qianli. Multi-scale skip deep long short-term memory network for short-term multivariate load forecasting [J]. Journal of Computer Applications, 2021, 41(1): 231-236.
[9]	GAO Shile, WANG Ying, LI Hailin, WAN Xiaoji. Prediction method on financial time series data based on matrix profile [J]. Journal of Computer Applications, 2021, 41(1): 199-207.
[10]	ZHANG Xiaohan, FENG Aimin. Short-term traffic flow prediction based on empirical mode decomposition and long short-term memory neural network [J]. Journal of Computer Applications, 2021, 41(1): 225-230.
[11]	GOU Zi'an, ZHANG Xiao, WU Dongnan, WANG Yanqiu. Log analysis and workload characteristic extraction in distributed storage system [J]. Journal of Computer Applications, 2020, 40(9): 2586-2593.
[12]	GUO Xiuting, ZHU Changsheng, ZHANG Shengcai, ZHAO Kuipeng. Application of fractal interpolation in wind speed time series [J]. Journal of Computer Applications, 2020, 40(9): 2628-2633.
[13]	HU Min, BAI Xue, XU Wei, WU Bingjian. Review of anomaly detection algorithms for multidimensional time series [J]. Journal of Computer Applications, 2020, 40(6): 1553-1564.
[14]	HUO Weigang, WANG Huifang. Time series anomaly detection method based on autoencoder and HMM [J]. Journal of Computer Applications, 2020, 40(5): 1329-1334.
[15]	ZHANG Li, KONG Xu, SUN Zhonggui. Matrix completion algorithm based on nonlocal self-similarity and low-rank matrix approximation [J]. Journal of Computer Applications, 2020, 40(11): 3327-3331.