Bandwidth resource prediction and management of Web applications hosted on cloud

doi:10.11772/j.issn.1001-9081.2019050903

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (1): 181-187.DOI: 10.11772/j.issn.1001-9081.2019050903

• Network and communications • Previous Articles Next Articles

Bandwidth resource prediction and management of Web applications hosted on cloud

SUN Tianqi¹, HU Jianpeng^1,2, HUANG Juan¹, FAN Ying¹

1. School of Electronic and Electrical Engineering, Shanghai University of Engineering Science, Shanghai 201620, China;
2. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

Received:2019-05-29 Revised:2019-08-11 Online:2020-01-10 Published:2019-09-10
Contact: 胡建鹏
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61232007, 61802252).

云环境下Web应用带宽资源预测与管理

孙天齐¹, 胡建鹏^1,2, 黄娟¹, 樊莹¹

1. 上海工程技术大学电子电气工程学院, 上海 201620;
2. 上海交通大学计算机科学与工程系, 上海 200240

作者简介:孙天齐(1994-),男,安徽界首人,硕士研究生,CCF会员,主要研究方向:服务计算、数据挖掘;胡建鹏(1980-),男,湖北新洲人,副教授,博士研究生,CCF会员,主要研究方向:软件工程、数据工程;黄娟(1982-),女,山东淄博人,实验师,硕士,主要研究方向:大数据分析;樊莹(1992-),女,河南焦作人,硕士研究生,主要研究方向:云计算、数据挖掘。
基金资助:
国家自然科学基金资助项目（61232007，61802252）。

Abstract

Abstract: To address the problem of bandwidth resource management in Web applications, a prediction method for bandwidth requirement and Quality of Service (QoS) of Web applications based on network simulation was proposed. A modeling framework and formal specification were presented for Web services, a simplified parallel workload model was adopted, the model parameters were extracted from Web application access logs by means of automated data mining, and the complex network transmission process was simulated by using network simulation tool. As a result, the bandwidth requirement and changes on QoS were able to be predicted under different workload intensities. A classic benchmark system named TPC-W was used to evaluate the accuracy of prediction results. Theoretical analysis and simulation results show that compared with traditional linear regression prediction, network simulation can stably simulate real system, the predicted average relative error for total request number and total byte number is 4.6% and 3.3% respectively. Finally, with different bandwidth scaling schemes simulated and evaluated based on the TPC-W benchmark system, the results can provide decision support for resource management of Web applications.

Key words: Web application, network simulation, bandwidth management, prediction, log mining, Quality of Service (QoS)

摘要： 针对Web应用带宽资源管理问题，提出了一种基于网络仿真的Web应用带宽需求和服务质量（QoS）预测方法，该方法给出了适用于Web服务的建模框架与形式说明，采用简化的并行负载模型，并运用自动化数据挖掘方法从Web应用访问日志中提取模型参数，并使用网络仿真工具建立系统模型模拟复杂网络传输过程，能够预测不同负载强度下的带宽需求和QoS变化。通过TPC-W基准测试系统验证该方法预测结果的准确性，理论分析和仿真结果表明，与传统的线性回归预测相比，网络仿真可以稳定地模拟真实系统，其对总请求数和总字节数的预测平均相对误差分别为4.6%和3.3%。最后以TPC-W基准系统为例，对Web应用不同带宽伸缩方案进行仿真评估，评估结果可以为Web应用资源管理提供决策支持。

关键词: Web应用, 网络仿真, 带宽管理, 预测, 日志挖掘, 服务质量

CLC Number:

TP311.5

SUN Tianqi, HU Jianpeng, HUANG Juan, FAN Ying. Bandwidth resource prediction and management of Web applications hosted on cloud[J]. Journal of Computer Applications, 2020, 40(1): 181-187.

孙天齐, 胡建鹏, 黄娟, 樊莹. 云环境下Web应用带宽资源预测与管理[J]. 计算机应用, 2020, 40(1): 181-187.

References

[1] 冯登国,张敏,张妍,等. 云计算安全研究[J]. 软件学报, 2011, 22(1):71-83. (FENG D G, ZHANG M, ZHANG Y, et al. Study on cloud computing security[J]. Journal of Software, 2011, 22(1):71-83.)
[2] 莫志超,张未展,王军,等. 基于云计算的P2P流媒体服务器集群部署算法[J]. 计算机应用, 2014, 34(2):365-368. (MO Z C, ZHANG W Z, WANG J, et al. P2P streaming media server cluster deployment algorithm based on cloud computing[J]. Journal of Computer Applications, 2014, 34(2):365-368.)
[3] DESNOYERS P, WOOD T, SHENOY P. Modellus:automated modeling of complex data center applications[J]. ACM Transactions on the Web, 2012, 6(2):No.8.
[4] HUANG F, ZHANG S, YUAN C, et al. Memory performance prediction of Web server applications based on grey system theory[C]//Proceedings of the 2012 Asia-Pacific Web Conference, LNCS 7235. Berlin:Springer, 2012:660-668.
[5] CABAN D, WALKOWIAK T. Prediction of the performance of Web based systems[J]. Advances in Intelligent Systems and Computing, 2015, 307:1-18.
[6] VEERARAGHAVAN K, MEZA J, CHOU D, et al. Kraken:leveraging live traffic tests to identify and resolve resource utilization bottlenecks in large scale Web services[C]//Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. Berkeley, CA:USENIX Association, 2016:635-651.
[7] ZHENG W, BIANCHINI R, JANAKIRAMAN G J, et al. Jus-tRunIt:experiment-based management of virtualized data centers[EB/OL].[2019-05-20]. https://www.usenix.org/legacy/event/usenix09/tech/full_papers/zheng/zheng.pdf.
[8] ALAM F M, MOHAN S, FOWLER J W, et al. A discrete event simulation tool for performance management of Web-based application systems[J]. Journal of Simulation, 2012, 6(1):21-32.
[9] TARIQ M B, BHANDANKAR K, VALANCIUS V, et al. Answering "what-if" deployment and configuration questions with WISE:techniques and deployment experience[J]. IEEE/ACM Transactions on Networking, 2013, 21(1):1-13.
[10] ZHANG L, ZHANG B, PAHL C, et al. Personalized quality prediction for dynamic service management based on invocation patterns[C]//Proceedings of the 2013 International Conference on Service-Oriented Computing, LNCS 8274. Berlin:Springer, 2013:84-98.
[11] 黄翔,王伟,张文博,等. 面向性能剖析的Web应用自动性能建模方法[J]. 软件学报, 2012, 23(4):786-801. (HUANG X, WANG W, ZHANG W B, et al. Automatic performance modeling approach to performance profiling of Web applications[J]. Journal of Software, 2012, 23(4):786-801.)
[12] VÖGELE C, VAN HOORN A, SCHULZ E, et al. WESSBAS:extraction of probabilistic workload specifications for load testing and performance prediction-a model-driven approach for session-based application systems[J]. Software and Systems Modeling, 2018, 17(2):443-477.
[13] ABBORS F, TRUSCAN D, AHMAD T. Mining Web server logs for creating workload models[C]//Proceedings of the 2014 International Conference on Software Technologies, CCIS 555. Cham:Springer, 2014:131-150.
[14] TPC. TPC-W[EB/OL].[2018-08-20]. http://www.tpc.org/tpcw/default.asp.
[15] HU J, HUANG L, HUANG J, et al. What-if model construction and validation of Web systems based on log mining[C]//Proceedings of the 24th Asia-Pacific Software Engineering Conference. Piscataway:IEEE, 2017:505-512.
[16] University of Southern California, Information Science Institute. The network simulator-ns-2[EB/OL].[2018-08-15]. http://www.isi.edu/nsnam/ns/.
[17] VARGA A. The OMNet++ discrete event simulation system[C]//Proceedings of the 15th European Simulation Multiconference. Prague:[s.n.], 2001:319-324.
[18] OPNET Technologies. Network simulator[EB/OL].[2018-07-30]. https://www.riverbed.com/cn/products/steelcentral/opnet.html.
[19] University of Wisconsin-Madison, UW-Madison Computer Architecture Group. Predictive High-Performance Architecture Research Mavens (PHARM)[EB/OL].[2018-08-20]. http://pharm.ece.wisc.edu/.
[20] 阿里云. 公网带宽计费[EB/OL].[2018-09-22]. https://help.aliyun.com/document_detail/25411.html. (Alibaba Cloud. Public bandwidth billing[EB/OL].[2018-09-22]. https://help.aliyun.com/document_detail/25411.html.)

Bandwidth resource prediction and management of Web applications hosted on cloud

云环境下Web应用带宽资源预测与管理

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	CAI Biao, LI Ruicen, WU Yuanyuan. Impact and enhancement of similarity features on link prediction [J]. Journal of Computer Applications, 2021, 41(9): 2569-2577.
[2]	AN Xin, YANG Haijiao, LI Jianhua, REN Fuji. Dynamic mapping method for heterogeneous multi-core system under thermal safety constraint [J]. Journal of Computer Applications, 2021, 41(9): 2631-2638.
[3]	DAI Yurou, YANG Qing, ZHANG Fengli, ZHOU Fan. Trajectory prediction model of social network users based on self-supervised learning [J]. Journal of Computer Applications, 2021, 41(9): 2545-2551.
[4]	DING Yin, SANG Nan, LI Xiaoyu, WU Feizhou. Prediction method of capacity data in telecom industry based on recurrent neural network [J]. Journal of Computer Applications, 2021, 41(8): 2373-2378.
[5]	MENG Fan, CHEN Guang, WANG Yong, GAO Yang, GAO Dequn, JIA Wenlong. Multi-granularity temporal structure representation based outlier detection method for prediction of oil reservoir [J]. Journal of Computer Applications, 2021, 41(8): 2453-2459.
[6]	ZHANG Yuanjun, ZHANG Xihuang. Dynamic network representation learning model based on graph convolutional network and long short-term memory network [J]. Journal of Computer Applications, 2021, 41(7): 1857-1864.
[7]	LI Yangying, CHEN Zhijun, ZHANG Zihao, YOU Lan. Raw sugar demand forecasting model for sugar manufacturing enterprise based on modified Elman neural network [J]. Journal of Computer Applications, 2021, 41(7): 2113-2120.
[8]	WU Wei, LI Zeping, YANG Huawei, LIN Chuan, WANG Zhongde. Deep attention video popularity prediction model fusing content features and temporal information [J]. Journal of Computer Applications, 2021, 41(7): 1878-1884.
[9]	ZHOU Shuo, QIU Runhe, TANG Minjun. Power allocation algorithm for CR-NOMA system based on tabu search and Q-learning [J]. Journal of Computer Applications, 2021, 41(7): 2026-2032.
[10]	XU Guobao, CHEN Yuanxiao, WANG Ji. Drug-target association prediction algorithm based on graph convolutional network [J]. Journal of Computer Applications, 2021, 41(5): 1522-1526.
[11]	NI Shuiping, LI Huifang. Battery state-of-charge prediction method based on one-dimensional convolutional neural network combined with long short-term memory network [J]. Journal of Computer Applications, 2021, 41(5): 1514-1521.
[12]	LI Xujuan, PI Jianyong, HUANG Feixiang, JIA Haipeng. Self-generated deep neural network based 4D trajectory prediction [J]. Journal of Computer Applications, 2021, 41(5): 1492-1499.
[13]	ZHANG Xinhuan, LIU Hongjie, SHI Junqing, MAO Chengyuan, MENG Guolian. LSTM and artificial neural network for urban bus travel time prediction based on spatiotemporal eigenvectors [J]. Journal of Computer Applications, 2021, 41(3): 875-880.
[14]	TANG Yanqiang, LI Chenghai, SONG Yafei. Network security situation prediction based on improved particle swarm optimization and extreme learning machine [J]. Journal of Computer Applications, 2021, 41(3): 768-773.
[15]	YANG Xianfeng, GUI Hongjun, FU Chunchang. F-X domain predictive filtering parallel algorithm based on compute unified device architecture [J]. Journal of Computer Applications, 2021, 41(2): 486-491.