Dynamic load balancing mechanism in cloud-based virtual cluster system

doi:10.11772/j.issn.1001-9081.2014.11.3082

Journal of Computer Applications ›› 2014, Vol. 34 ›› Issue (11): 3082-3085.DOI: 10.11772/j.issn.1001-9081.2014.11.3082

Previous Articles Next Articles

Dynamic load balancing mechanism in cloud-based virtual cluster system

LI Liyao¹,²,⁴,ZHAO Shaoka¹,LIN Dongsen¹,XU Cong²,⁴,YANG Jiahai²,⁴

Received:2014-07-28 Revised:2014-08-06 Online:2014-11-01 Published:2014-12-01
Contact: LI Liyao

云环境下虚拟机集群系统动态负载均衡机制

李立耀¹,²,赵少卡¹,³,林东森¹,徐聪²,杨家海²

1. 福建师范大学福清分校数学与计算机科学系,福建福清 350300
2. 清华大学网络科学与网络空间研究院,北京 100084
3.

通讯作者: 李立耀
作者简介:李立耀(1970-),男,福建平潭人,副教授,主要研究方向:云计算、计算机网络;赵少卡(1980-),男,福建福州人,讲师,硕士,主要研究方向:云计算、软件工程;徐聪(1986-),男,黑龙江东宁人,博士研究生,主要研究方向:计算机网络;杨家海(1966-),男,浙江云和人,教授,博士,主要研究方向:计算机网络。
基金资助:
清华-思科联合实验室研究基金项目;教育部—中国移动研究基金资助项目;福建省教育厅科技项目

Abstract

Abstract:

As the conventional physical cluster system fails to cope flexibly with large-scale Internet applications, a comprehensive load balancing mechanism for cloud-based virtual cluster system was proposed. It first periodically collected CPU and memory usage, number of connections, and response time of all virtual machines and physical hosts, then calculated the weighted load of the physical hosts, and finally scheduled and assigned the task requests based on the calculated comprehensive load, thus could adapt to the complex, dynamic and variable computing environment. The experimental results show that, compared with other scheduling mechanisms such as Weighted Round Robin (WRR) and Weighted Least Connections (WLC), the proposed mechanism is delay optimal under heavy workload, and moreover, it can increase or decrease the number of Virtual Machines (VMs) dynamically to balance the server load usually within 5 seconds.

摘要：

针对传统的物理集群系统无法灵活应对大型互联网应用的问题,提出一种云环境下虚拟机集群的综合负载均衡机制。该方法首先定期地采集集群中虚拟机节点的CPU、内存、连接数、响应时间,以及所在物理主机的负载状况等指标信息,然后加权计算节点的综合负载并得出其权值,最后通过调度器进行任务请求的合理分配,从而解决了传统集群系统负载不均且不能适应多变的网络环境等诸多问题。实验结果表明,与加权轮询法(WRR)和加权最少连接法(WLC)调度方案相比,该机制能够在并发量较大时维持较低的响应时间,并能够根据集群中综合负载的状态实时地增加或减少虚拟机数量,通常在5s之内达到整体集群的负载均衡。

CLC Number:

TP393

LI Liyao ZHAO Shaoka LIN Dongsen XU Cong YANG Jiahai. Dynamic load balancing mechanism in cloud-based virtual cluster system[J]. Journal of Computer Applications, 2014, 34(11): 3082-3085.

李立耀赵少卡林东森徐聪杨家海. 云环境下虚拟机集群系统动态负载均衡机制[J]. 计算机应用, 2014, 34(11): 3082-3085.

References

[1]RAJKUMAR B, SHIN Y C, VENUGOPAL S, et al.Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility[J]. Future Generation Computer Systems,2009,25(6):599-616.
[2]LUO J, JIN J, SONG A, et al.Cloud computing: architecture and key technologies[J]. Journal on Communications,2011,32(7):3-21.(罗军舟, 金嘉晖, 宋爱波. 云计算:体系架构与关键技术[J]. 通信学报, 2011, 32(7):3-21.)
[3]DU Y, GUO T, CHEN J. Fleet elastic load balancing mechanism in cloud environment[J]. Journal of Computer Applications,2013,33(3):830-833.(杜垚,郭涛,陈俊杰.云环境下机群弹性负载均衡机制[J].计算机应用,2013,33(3):830-833.)
[4]JIAO Y, WANG W. Design and implementation of load balancing of distributed-system-based Web server[C]// Proceedings of the 2010 Third International Symposium on Electronic Commerce and Security. Piscataway: IEEE Press, 2010: 337-342.
[5]GILLY K, JUIZ C, PUIGJANER R. An up-to-date survey in Web load balancing[J]. World Wide Web, 2011, 14(2): 105-131.
[6]SPEITKAMP B, BICHLER M. A mathematical programming approach for server consolidation problems in virtualized data centers[J]. IEEE Transactions on Services Computing,2010,3(4):266-278.
[7]QIN X, XIE T. An availability-aware task scheduling strategy for heterogeneous systems[J]. IEEE Transactions on Computers, 2008,57(2):188-199.
[8]
ZHAO S, LI L, LING X, et al.Architecture and scheduling scheme design of Tsinghua cloud based on OpenStack[J]. Journal of Computer Applications,2013,33(12): 3335-3338.(赵少卡, 李立耀, 凌晓, 等. 基于OpenStack的清华云平台构建与调度方案设计[J]. 计算机应用, 2013, 33(12): 3335-3338.)
[9]MAGULURI S T, SRIKANT R, YING L. Stochastic models of load balancing and scheduling in cloud computing clusters[C]// Proceedings of the 2012 IEEE INFOCOMM. Piscataway: IEEE Press, 2012:702-710.
[10]MAGULURI S T, SRIKANT R, YING L. Heavy traffic optimal resource allocation algorithms for cloud computing clusters[EB/OL]. [2013-10-10]. http://arxiv.org/pdf/1206.1264v1.pdf.
[11]CHEN Y, HUAI J, HU C. Live migration of virtual machines based on hybrid memory copy approach[J]. Chinese Journal of Computers,2011,34(12):2278-2291.(陈阳, 怀进鹏, 胡春明. 基于内存混合复制方式的虚拟机在线迁移机制[J]. 计算机学报, 2011, 34(12): 2278-2291.)
[12]ZHANG W. LVS cluster load dispatch [EB/OL]. [2013-10-10]. http://www.linuxvirtualserver.org/zh/lvs4.html.(章文嵩. LVS集群的负载调度[EB/OL]. [2013-10-10]. http://www.linuxvirtualserver.org/zh/lvs4.html.)
[13]FENG L, FU Y, CHEN K, et al.TDDS: task deployment and scheduling based on virtual cluster system[J]. Journal of Computer Research and Development,2013,50(5):1118-1124.(冯琳, 付勇, 陈康, 等. TDDS: 基于虚拟集群系统的任务部署与调度[J]. 计算机研究与发展, 2013, 50(5): 1118-1124.)
[14]OpenStack installation guide for Ubuntu 12.04 [EB/OL].[2013-12-20].http://docs.openstack.org/havana/install-guide/install/apt/content/.

[1]	. Moving target defense decision-making algorithm based on multi-stage evolutionary signal game model [J]. Journal of Computer Applications, 0, (): 0-0.
[2]	ZHU Yuna, ZHANG Yutao, YAN Shaoge, FAN Yudan, CHEN Hantuo. Protocol identification approach based on semi-supervised subspace clustering [J]. Journal of Computer Applications, 2021, 41(10): 2900-2904.
[3]	. Positive influence maximization based on reverse influence sampling [J]. Journal of Computer Applications, 0, (): 0-0.
[4]	GUO Mian, ZHANG Jinyou. Computation offloading policy for machine learning in mobile edge computing environments [J]. Journal of Computer Applications, 2021, 41(9): 2639-2645.
[5]	NI Ping, CHEN Wei. Reflective cross-site scripting vulnerability detection based on fuzzing test [J]. Journal of Computer Applications, 2021, 41(9): 2594-2601.
[6]	. Secure offloading optimization of wireless powered mobile edge computing system [J]. Journal of Computer Applications, 0, (): 0-0.
[7]	. Cross chain mechanism based on Spark blockchain [J]. Journal of Computer Applications, 0, (): 0-0.
[8]	. Design and Simulation of Software Defined Network Flow Rule Conflict Detection System Based on OpenFlow [J]. Journal of Computer Applications, 0, (): 0-0.
[9]	. Transmission control protocol congestion control switching scheme based on scenario change [J]. Journal of Computer Applications, 0, (): 0-0.
[10]	CHEN Weiwei, CAO Li, GU Xiang. E-forensics model for internet of vehicles based on blockchain [J]. Journal of Computer Applications, 2021, 41(7): 1989-1995.
[11]	XIAO Yuelei, DENG Xiaofan. Improvement and analysis of certificate-based wired local area network security association scheme [J]. Journal of Computer Applications, 2021, 41(7): 1970-1976.
[12]	. Containerized virtual network embedding algorithm based on time-varying resources [J]. Journal of Computer Applications, 0, (): 0-0.
[13]	DONG Wentao, LI Zhuo, CHEN Xin. Online short video content distribution strategy based on federated learning [J]. Journal of Computer Applications, 2021, 41(6): 1551-1556.
[14]	SHI Anni, LI Taoshen, WANG Zhe, HE Lu. Relay selection strategy for cache-aided full-duplex simultaneous wireless information and power transfer system [J]. Journal of Computer Applications, 2021, 41(6): 1539-1545.
[15]	GE Lina, HU Yugu, ZHANG Guifen, CHEN Yuanyuan. Reverse hybrid access control scheme based on object attribute matching in cloud computing environment [J]. Journal of Computer Applications, 2021, 41(6): 1604-1610.

Dynamic load balancing mechanism in cloud-based virtual cluster system

云环境下虚拟机集群系统动态负载均衡机制

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics