基于需求预测的PaaS平台资源分配方法

doi:10.11772/j.issn.1001-9081.2018122613

计算机应用 ›› 2019, Vol. 39 ›› Issue (6): 1583-1588.DOI: 10.11772/j.issn.1001-9081.2018122613

• 2018全国高性能计算学术年会(HPC China 2018)论文 • 上一篇下一篇

基于需求预测的PaaS平台资源分配方法

徐雅斌^1,2, 彭宏恩¹

1. 北京信息科技大学计算机学院, 北京 100101;
2. 网络文化与数字传播北京市重点实验室(北京信息科技大学), 北京 100101

收稿日期:2018-12-12 修回日期:2019-03-26 发布日期:2019-06-17 出版日期:2019-06-10
通讯作者: 徐雅斌
作者简介:徐雅斌(1962-),男、辽宁锦州人,教授,硕士,CCF高级会员,主要研究方向:云计算、社交网络、大数据;彭宏恩(1990-),男,河北唐山人,研士究生,CCF会员,主要研究方向:云计算。
基金资助:
网络文化与数字传播北京市重点实验室项目（ICDDXN004）；信息网络安全公安部重点实验室开放课题资助项目（C18601）。

PaaS platform resource allocation method based on demand forecasting

XU Yabin^1,2, PENG Hong'en¹

1. College of Computer Science, Beijing Information Science & Technology University, Beijing 100101, China;
2. Beijing Key Laboratory of Internet Culture and Digital Dissemination Research(Beijing Information Science & Technology University), Beijing 100101, China

Received:2018-12-12 Revised:2019-03-26 Online:2019-06-17 Published:2019-06-10
Supported by:
This work is partially supported by the Project of Beijing Key Laboratory of Internet Culture and Digital Dissemination Research (ICDDXN004), the Project of Key Lab of Information Network Security, Ministry of Public Security (C18601).

摘要/Abstract

摘要： 针对缺乏PaaS平台下资源需求的有效预测与优化分配的问题，提出一种资源需求预测模型和分配方法。首先，根据PaaS平台中应用对资源需求的周期性来对资源序列进行切分，并在短期预测的基础上结合应用的多周期性特征，利用多元回归算法建立综合的预测模型。然后，基于MapReduce架构设计实现了一个Master-Slave模式的PaaS平台资源分配系统。最后，结合当前任务请求和资源需求预测结果进行资源分配。实验结果表明，采用该资源需求预测模型和分配方法后，相比于自回归模型和指数平滑算法，平均绝对百分比误差分别下降8.71个百分点和2.07个百分点，均方根误差分别下降2.01个百分点和0.46个百分点。所提预测模型的预测结果不仅误差小，与真实值的拟合程度也较高，而且利用较小的时间开销就可以获得较高的准确度。此外，使用该预测模型的PaaS平台的资源请求的平均等待时间有了明显的下降。

关键词: 云计算, 平台即服务, 需求预测, 资源分配, 多元回归

Abstract: In view of the lack of effective resource demand forecasting and optimal allocation in Platform-as-a-Service (PaaS) platform, a resource demand forecasting model and an allocation method were proposed. Firstly, according to the periodicity of the application demand for resources in PaaS platform, the resource sequence was segmented. And on the basis of short-term prediction, combined with the multi-periodicity characteristics of the application, a comprehensive prediction model was established by using the multiple regression algorithm. Then, based on MapReduce architecture, a PaaS platform resource allocation system based on Master-Slave mode was designed and implemented. Finally, the resources were allocated based on current task request and resource demand prediction results. The experimental results show that, compared with autoregressive model and exponential smoothing algorithm, the proposed resource demand forecasting model and allocation method has the mean absolute percentage error drop of 8.71 percentage points and 2.07 percentage points respectively, root mean square error drop of 2.01 percentage points and 0.46 percentage points respectively. It can be seen that the prediction result of the prediction model has little error and its fitting degree with real value is high, while high accuracy costs little time. Besides, the average waiting time of PaaS platform with the proposed prediction model for resource requests decreases significantly.

Key words: cloud computing, Platform-as-a-Service (PaaS), demand forecasting, resource allocation, multiple regression

中图分类号:

徐雅斌, 彭宏恩. 基于需求预测的PaaS平台资源分配方法[J]. 计算机应用, 2019, 39(6): 1583-1588.

XU Yabin, PENG Hong'en. PaaS platform resource allocation method based on demand forecasting[J]. Journal of Computer Applications, 2019, 39(6): 1583-1588.

参考文献

[1] ARMBRUST M, FOX A, GRIFFITH R, et al. A view of cloud computing[J]. Communications of the ACM, 2010, 53(4):50-58.
[2] XU P, ZHANG Y, SUN S. PaaS cloud resource scheduling techno-logy research[J]. Journal of Huazhong University of Science and Technology (Natural Science Edition), 2013, S2(41):53-56.
[3] XU L, ZHANG S, LI J. A density based performance prediction model for cloud services[C]//Proceedings of the 2013 International Conference on Cloud Computing and Big Data. Washington, DC:IEEE Computer Society, 2013:92-99.
[4] HU Y, DENG B, PENG F, et al. Workload prediction for cloud computing elasticity mechanism[C]//Proceedings of the 2016 IEEE International Conference on Cloud Computing and Big Data Analysis. Piscataway, NJ:IEEE, 2016:244-249.
[5] 周文俊,曹健.基于预测及蚁群算法的云计算资源调度策略[J].计算机仿真,2012,29(9):239-242.(ZHOU W J, CAO J. Cloud computing resource scheduling strategy based on prediction and ACO algorithm[J]. Computer Simulation, 2012, 29(9):239-242.)
[6] WANG C, HUNG W, YANG C. A prediction based energy conserving resources allocation scheme for cloud computing[C]//Proceedings of the 2014 IEEE International Conference on Granular Computing. Piscataway, NJ:IEEE, 2014:320-324.
[7] GONG Z, GU X, WILKES J. Press:predictive elastic resource scaling for cloud systems[C]//Proceedings of the 2010 International Conference on Network and Service Management. Piscataway, NJ:IEEE, 2010:9-16.
[8] ROY N, DUBEY A, GOKHALE A. Efficient autoscaling in the cloud using predictive models for workload forecasting[C]//Proceedings of the 4th IEEE International Conference on Cloud Computing. Piscataway, NJ:IEEE, 2011:500-507.
[9] SONG W, XIAO Z, CHEN Q. Dynamic resource allocation using virtual machines for cloud computing environment[J]. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(6):1107-1117.
[10] 徐浩.基于神经网络的虚拟机能耗预测模型研究[D].北京:北京邮电大学,2015:41-49.(XU H. Research on neural network based virtual machine's power prediction model[D]. Beijing:Beijing University of Posts and Telecommunications, 2015:41-49.)
[11] 王维,张英堂.BP神经网络进行时问序列预测的不足及改进[J].计算机工程与设计,2007,28(21):5292-5294.(WANG W, ZHANG Y T. Analysis and improving way of BP ANN in predicting time series data[J]. Computer Engineering and Design, 2007, 28(21):5292-5294.)
[12] 孟煜,张斌,郭军,等.云计算环境下云服务用户并发量的区间预测模型[J].计算机学报,2017,40(2):378-396.(MENG Y, ZHANG B, GUO J, et al. Prediction interval estimation model of user concurrent request for cloud service in cloud environment[J]. Chinese Journal of Computers, 2017, 40(2):378-396.)
[13] JIANG Y, PERNG C, CHEN R, et al. ASAP:a self-adaptive prediction system for instant cloud resource demand provisioning[C]//Proceedings of the 2011 IEEE 11th International Conference on Data Mining. Piscataway, NJ:IEEE, 2011:1104-1109.
[14] PARK S, MUN Y. Prediction method about power consumption by using utilization rate of resource in cloud computing environment[C]//Proceedings of the 2016 International Conference on Big Data and Smart Computing. Piscataway, NJ:IEEE, 2016:265-268.
[15] 温鉴荣.PaaS云平台中Java Web应用调度机制的研究与实现[D].北京:北京邮电大学,2013:10-19.(WEN J R. Research and implementation of Java Web application scheduling mechanism in PaaS[D]. Beijing:Beijing University of Posts and Telecommunications, 2013:10-19.)
[16] CHEN H, FU X, TANG Z, et al. Resource monitoring and prediction in cloud computing environments[C]//Proceedings of the 3rd International Conference on Applied Computing and Information Technology/2nd International Conference on Computational Science and Intelligence. Piscataway, NJ:IEEE, 2015:288-292.
[17] XU D, ZHANG X. An incremental clustering pattern sequence-based short-term load prediction for cloud computing[J]. International Journal of Grid and Utility Computing, 2016, 7(4):304-312.)
[18] SHUMWAY R H, STOFFER D S. Time Series Analysis and Its Applications:with R Examples[M]. Berlin:Springer, 2006:84-165.
[19] 张显,王建学,王锡凡,等.考虑多重周期性的短期电价预测[J].电力系统自动化,2007,31(3):4-8.(ZHANG X, WANG J X, WANG X F, et al. Short-term electricity price forecasting based on price subsequences[J]. Automation of Electric Power Systems, 2007, 31(3):4-8.)
[20] 沈富可,张卫,常潘.应用时间序列分析进行网络负载预测[J].中山大学学报(自然科学版),2009,48(S1):84-86.(SHEN F K, ZHANG W, CHANG P. Time series analysis used to predict network load[J]. Acta Scientiarum Naturalium Universitatis Sunyatseni, 2009, 48(S1):84-86.)
[21] 赵宏伟,申德荣,田力威.云计算环境下资源需求预测与调度方法的研究[J].小型微型计算机系统,2016,37(4):659-663.(ZHAO H W, SHEN D R, TIAN L W. Research on resources forecasting and scheduling method in cloud computing environment[J]. Journal of Chinese Computer Systems, 2016, 37(4):659-663.)

基于需求预测的PaaS平台资源分配方法

PaaS platform resource allocation method based on demand forecasting

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	陈家豪, 殷新春. 基于云雾计算的可追踪可撤销密文策略属性基加密方案[J]. 计算机应用, 2021, 41(6): 1611-1620.
[2]	葛丽娜, 胡雨谷, 张桂芬, 陈园园. 云计算环境基于客体属性匹配的逆向混合访问控制方案[J]. 计算机应用, 2021, 41(6): 1604-1610.
[3]	杨翎, 姜春茂. 基于三支决策的虚拟机节能迁移策略[J]. 计算机应用, 2021, 41(4): 990-998.
[4]	孙晓玲, 杨光, 沈焱萍, 杨秋格, 陈涛. 基于可拆分倒排索引的可搜索加密方案[J]. 《计算机应用》唯一官方网站, 2021, 41(11): 3288-3294.
[5]	吕佳玉, 竺智荣, 姚志强. 云计算环境下的双通道数据动态加密策略[J]. 计算机应用, 2020, 40(8): 2268-2273.
[6]	陈程军, 毛莺池, 王绎超. 基于激活-熵的分层迭代剪枝策略的CNN模型压缩[J]. 计算机应用, 2020, 40(5): 1260-1265.
[7]	郭曙杰, 李志华, 蔺凯青. 云环境下基于模糊隶属度的虚拟机放置算法[J]. 计算机应用, 2020, 40(5): 1374-1381.
[8]	黄冬艳, 付中卫, 王波. 计算资源受限的移动边缘计算服务器收益优化策略[J]. 计算机应用, 2020, 40(3): 765-769.
[9]	许英鑫, 孙磊, 赵建成, 郭松辉. 基于蚁群优化算法的虚拟现场可编程门阵列部署策略[J]. 计算机应用, 2020, 40(3): 747-752.
[10]	王庆永, 毛莺池, 王绎超, 王龙宝. 基于多微云协作的计算任务卸载[J]. 《计算机应用》唯一官方网站, 2020, 40(2): 328-334.
[11]	刘福鑫, 李劲巍, 王熠弘, 李琳. 基于Kubernetes的云原生海量数据存储系统设计与实现[J]. 《计算机应用》唯一官方网站, 2020, 40(2): 547-552.
[12]	黄秀丽, 黄进, 于鹏飞, 缪巍巍, 杨如侠, 李怡静, 喻鹏. 电力无线专网中面向安全风险的分布式资源分配方法[J]. 计算机应用, 2020, 40(12): 3586-3593.
[13]	杨哂哂, 吴慧珍, 庄黎丽, 吕宏武. 基于Markov过程的IaaS系统可用性建模与分析方法[J]. 计算机应用, 2020, 40(10): 3013-3018.
[14]	程文亮, 王志宏, 周虞, 过弋, 赵俊锋. 面向外汇市场监测的分布式计算框架设计[J]. 计算机应用, 2020, 40(1): 173-180.
[15]	林立, 熊金波, 肖如良, 林铭炜, 陈秀华. Gaming@Edge:基于边缘节点的低延迟云游戏系统[J]. 计算机应用, 2019, 39(7): 2001-2007.