Virtual machine dynamic consolidation method based on adaptive overloaded threshold selection

doi:10.11772/j.issn.1001-9081.2016.10.2698

Journal of Computer Applications ›› 2016, Vol. 36 ›› Issue (10): 2698-2703.DOI: 10.11772/j.issn.1001-9081.2016.10.2698

Previous Articles Next Articles

Virtual machine dynamic consolidation method based on adaptive overloaded threshold selection

YAN Chengyu¹, LI Zhihua^1,2, YU Xinrong¹

1. School of IoT Engineering, Jiangnan University, Wuxi Jiangsu 214122, China;
2. Engineering Research Center of IoT Technology Application, Ministry of Education (Jiangnan University), Wuxi Jiangsu 214122, China

Received:2016-04-11 Revised:2016-06-16 Online:2016-10-10 Published:2016-10-10
Supported by:
BackgroundThis work is partially supported by the Production, Teaching and Scientific Innovation Fund of Science and Technology Department of Jiangsu Province (BY2013015-23).

基于自适应过载阈值选择的虚拟机动态整合方法

闫成雨¹, 李志华^1,2, 喻新荣¹

1. 江南大学物联网工程学院, 江苏无锡 214122;
2. 物联网应用技术教育部工程研究中心(江南大学), 江苏无锡 214122

通讯作者: 闫成雨,E-mail:cheneyyin@hotmail.com
作者简介:闫成雨(1992—),男,江苏徐州人,硕士研究生,CCF会员,主要研究方向:云计算、网格计算、分布式计算;李志华(1969—),男,湖南保靖人,副教授,博士,主要研究方向:计算机网络、信息安全、数据挖掘;喻新荣(1992—),男,江苏南通人,硕士研究生,主要研究方向:云计算、并行计算、分布式计算。
基金资助:
江苏省科技厅产学研联合创新基金资助项目（BY2013015-23）。

Abstract

Abstract: Considering the uncertainty of dynamic workloads in cloud computing, an Virtual Machine (VM) dynamic consolidation method based on adaptive overloaded threshold selection was proposed. In order to make a trade-off between energy efficiency and Quantity of Services (QoS) of data centers, an adaptive overloaded threshold selection problem model based on Markov decision processes was designed. The optimal decision was calculated by solving this problem model, and the overloaded threshold was dynamically adjusted by using the optimal decision according to energy efficiency and QoS of data center. Overloaded threshold was used to predict overloaded hosts and trigger VM migrations. According to the principle of minimum migration time and minimum energy consumption growth, the VM migration strategy under overloaded threshold constraint was given, and the underloaded hosts were switched to sleep mode. Simulation results show that this method can significantly avoid excessive virtual machine migrations and decrease the energy consumption while improving QoS effectively; in addition, it can achieve an ideal balance between QoS and energy consumption of data center.

Key words: cloud computing, Virtual Machine (VM) consolidation, Markov decision processes, Quantity of Service (QoS), energy efficiency

摘要： 针对云环境下动态工作负载的不确定性，提出了基于自适应过载阈值选择的虚拟机动态整合方法。为了权衡数据中心能源有效性与服务质量间的关系，将自适应过载阈值的选择问题建模为马尔可夫决策过程，计算过载阈值的最优选择策略，并根据系统能效和服务质量调整阈值。通过过载阈值检测过载物理主机，然后根据最小迁移时间原则以及最小能耗增加放置原则确定虚拟机的迁移策略，最后切换轻负载物理主机至休眠状态完成虚拟机整合。仿真实验结果表明，所提出的方法在减少虚拟机迁移次数方面效果显著，在节约数据中心能源开销与保证服务质量方面表现良好，在能源的有效性与云服务质量二者之间取得了比较理想的平衡。

关键词: 云计算, 虚拟机整合, 马尔可夫决策过程, 服务质量, 能源有效性

CLC Number:

TP393

YAN Chengyu, LI Zhihua, YU Xinrong. Virtual machine dynamic consolidation method based on adaptive overloaded threshold selection[J]. Journal of Computer Applications, 2016, 36(10): 2698-2703.

闫成雨, 李志华, 喻新荣. 基于自适应过载阈值选择的虚拟机动态整合方法[J]. 计算机应用, 2016, 36(10): 2698-2703.

References

[1] 李铭夫, 毕经平, 李忠诚. 资源调度等待开销感知的虚拟机整合[J]. 软件学报, 2014, 25(7):1388-1402.(LI M F, BI J P, LI Z C. Resource-scheduling-waiting-aware virtual machine consolidation [J]. Journal of Software, 2014, 25(7):1388-1402.)
[2] BIRKE R, CHEN L Y, SMIRNI E. Data centers in the cloud: a large scale performance study [C]//Proceedings of the 2013 IEEE Sixth International Conference on Cloud Computing. Piscataway, NJ: IEEE, 2012:336-343.
[3] GANDHI A, HARCHOL-BALTER M, DAS R, et al. Optimal power allocation in server farms [J]. ACM SIGMETRICS Performance Evaluation Review, 2009, 37(1):157-168.
[4] BELOGLAZOV A, ABAWAJY J, BUYYA R. Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing [J]. Future Generation Computer Systems, 2012, 28(5): 755-768.
[5] 向洁, 丁恩杰. 基于虚拟机调度的数据中心节能优化[J]. 计算机应用, 2013, 33(12):3331-3334.(XIANG J, DING E J. Energy-saving optimization in datacenter based on virtual machine scheduling [J]. Journal of Computer Applications, 2013, 33(12):3331-3334.)
[6] 李小六, 张曦煌. 虚拟化云计算数据中心能量感知资源分配机制[J]. 计算机应用, 2013, 33(12):3586-3590.(LI X L, ZHANG X H. Energy-aware resource management mechanism for virtualized cloud datacenter [J]. Journal of Computer Applications, 2013, 33(12):3586-3590.)
[7] 王加昌, 曾辉, 何腾蛟, 等. 面向数据中心的虚拟机部署及优化算法[J]. 计算机应用, 2013, 33(10):2772-2777.(WANG J C, ZENG H, HE T J, et al. Virtual machine placement and optimization for data center [J]. Journal of Computer Applications, 2013, 33(10):2772-2777.)
[8] BELOGLAZOV A, BUYYA R. Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud data centers [J]. Concurrency and Computation: Practice and Experience, 2012, 24(13): 1397-1420.
[9] BELOGLAZOV A, BUYYA R. Managing overloaded hosts for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints [J]. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(7): 1366-1379.
[10] CHEN L, SHEN H, SAPRA K. Distributed autonomous virtual resource management in datacenters using finite-Markov decision process [C]//SOCC 2014: Proceedings of the 2014 ACM Symposium on Cloud Computing. New York: ACM, 2014: 1-13.
[11] FELLER E, RILLING L, MORIN C. Energy-aware ant colony based workload placement in clouds [C]//Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing. Washington, DC: IEEE Computer Society, 2011: 26-33.
[12] GARG S K, TOOSI A N, GOPALAIYENGAR S K, et al. SLA-based virtual machine management for heterogeneous workloads in a cloud datacenter [J]. Journal of Network and Computer Applications, 2014, 45: 108-120.
[13] MANN Z A. Rigorous results on the effectiveness of some heuristics for the consolidation of virtual machines in a cloud data center [J]. Future Generation Computer Systems, 2015, 51:1-6.
[14] 刘克. 实用马尔可夫决策过程[M]. 北京: 清华大学出版社, 2004:33-41.(LIU K. Applied Markov decision processes [M]. Beijing: Tsinghua University Press, 2004:33-41.)
[15] CALHEIROS R N, RANJAN R, BELOGLAZOV A, et al. CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms [J]. Software: Practice and Experience, 2011, 41(1): 23-50.
[16] LI M, BI J, LI Z. Improving consolidation of virtual machine based on virtual switching overhead estimation [J]. Journal of Network and Computer Applications, 2016, 59(C):158-167.
[17] GAGGERO M, CAVIGLIONE L. Predictive control for energy-aware consolidation in cloud datacenters [J]. IEEE Transactions on Control Systems Technology, 2016, 24(2):461-474.

Virtual machine dynamic consolidation method based on adaptive overloaded threshold selection

基于自适应过载阈值选择的虚拟机动态整合方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	CHEN Jiahao, YIN Xinchun. Traceable and revocable ciphertext-policy attribute-based encryption scheme based on cloud-fog computing [J]. Journal of Computer Applications, 2021, 41(6): 1611-1620.
[2]	GE Lina, HU Yugu, ZHANG Guifen, CHEN Yuanyuan. Reverse hybrid access control scheme based on object attribute matching in cloud computing environment [J]. Journal of Computer Applications, 2021, 41(6): 1604-1610.
[3]	YANG Ling, JIANG Chunmao. Strategy of energy-aware virtual machine migration based on three-way decision [J]. Journal of Computer Applications, 2021, 41(4): 990-998.
[4]	Xiaoling SUN, Guang YANG, Yanping SHEN, Qiuge YANG, Tao CHEN. Searchable encryption scheme based on splittable inverted index [J]. Journal of Computer Applications, 2021, 41(11): 3288-3294.
[5]	LYU Jiayu, ZHU Zhirong, YAO Zhiqiang. Two-channel dynamic data encryption strategy in cloud computing environment [J]. Journal of Computer Applications, 2020, 40(8): 2268-2273.
[6]	CHEN Chengjun, MAO Yingchi, WANG Yichao. CNN model compression based on activation-entropy based layer-wise iterative pruning strategy [J]. Journal of Computer Applications, 2020, 40(5): 1260-1265.
[7]	GUO Shujie, LI Zhihua, LIN Kaiqing. Fuzzy membership degree based virtual machine placement algorithmin cloud environment [J]. Journal of Computer Applications, 2020, 40(5): 1374-1381.
[8]	CHEN Yonghong, GUO Lili, ZHANG Shibing, YANG Jie. Energy efficiency optimization of heterogeneous cellular networks based on transmitting power of pico base station [J]. Journal of Computer Applications, 2020, 40(4): 1115-1118.
[9]	XU Yingxin, SUN Lei, ZHAO Jiancheng, GUO Songhui. Virtual field programmable gate array placement strategy based on ant colony optimization algorithm [J]. Journal of Computer Applications, 2020, 40(3): 747-752.
[10]	WANG Qingyong, MAO Yingchi, WANG Yichao, WANG Longbao. Computing task offloading based on multi-cloudlet collaboration [J]. Journal of Computer Applications, 2020, 40(2): 328-334.
[11]	LIU Fuxin, LI Jingwei, WANG Yihong, LI Lin. Design and implementation of cloud native massive data storage system based on Kubernetes [J]. Journal of Computer Applications, 2020, 40(2): 547-552.
[12]	YANG Shenshen, WU Huizhen, ZHUANG Lili, LYU Hongwu. Markov process-based availability modeling and analysis method of IaaS system [J]. Journal of Computer Applications, 2020, 40(10): 3013-3018.
[13]	LIN Li, XIONG Jinbo, XIAO Ruliang, LIN Mingwei, CHEN Xiuhua. Gaming@Edge: low latency cloud gaming system based on edge nodes [J]. Journal of Computer Applications, 2019, 39(7): 2001-2007.
[14]	XU Yabin, PENG Hong'en. PaaS platform resource allocation method based on demand forecasting [J]. Journal of Computer Applications, 2019, 39(6): 1583-1588.
[15]	LI Qirui, PENG Zhiping, CUI Delong, HE Jieguang. Optimization of virtual resource deployment strategy in container cloud [J]. Journal of Computer Applications, 2019, 39(3): 784-789.