Dynamic load balancing mechanism in cloud-based virtual cluster system

doi:10.11772/j.issn.1001-9081.2014.11.3082

Journal of Computer Applications ›› 2014, Vol. 34 ›› Issue (11): 3082-3085.DOI: 10.11772/j.issn.1001-9081.2014.11.3082

Previous Articles Next Articles

Dynamic load balancing mechanism in cloud-based virtual cluster system

LI Liyao¹,²,⁴,ZHAO Shaoka¹,LIN Dongsen¹,XU Cong²,⁴,YANG Jiahai²,⁴

Received:2014-07-28 Revised:2014-08-06 Online:2014-12-01 Published:2014-11-01
Contact: LI Liyao

云环境下虚拟机集群系统动态负载均衡机制

李立耀¹,²,赵少卡¹,³,林东森¹,徐聪²,杨家海²

1. 福建师范大学福清分校数学与计算机科学系,福建福清 350300
2. 清华大学网络科学与网络空间研究院,北京 100084
3.

通讯作者: 李立耀
作者简介:李立耀(1970-),男,福建平潭人,副教授,主要研究方向:云计算、计算机网络;赵少卡(1980-),男,福建福州人,讲师,硕士,主要研究方向:云计算、软件工程;徐聪(1986-),男,黑龙江东宁人,博士研究生,主要研究方向:计算机网络;杨家海(1966-),男,浙江云和人,教授,博士,主要研究方向:计算机网络。
基金资助:
清华-思科联合实验室研究基金项目;教育部—中国移动研究基金资助项目;福建省教育厅科技项目

Abstract

Abstract:

As the conventional physical cluster system fails to cope flexibly with large-scale Internet applications, a comprehensive load balancing mechanism for cloud-based virtual cluster system was proposed. It first periodically collected CPU and memory usage, number of connections, and response time of all virtual machines and physical hosts, then calculated the weighted load of the physical hosts, and finally scheduled and assigned the task requests based on the calculated comprehensive load, thus could adapt to the complex, dynamic and variable computing environment. The experimental results show that, compared with other scheduling mechanisms such as Weighted Round Robin (WRR) and Weighted Least Connections (WLC), the proposed mechanism is delay optimal under heavy workload, and moreover, it can increase or decrease the number of Virtual Machines (VMs) dynamically to balance the server load usually within 5 seconds.

摘要：

针对传统的物理集群系统无法灵活应对大型互联网应用的问题,提出一种云环境下虚拟机集群的综合负载均衡机制。该方法首先定期地采集集群中虚拟机节点的CPU、内存、连接数、响应时间,以及所在物理主机的负载状况等指标信息,然后加权计算节点的综合负载并得出其权值,最后通过调度器进行任务请求的合理分配,从而解决了传统集群系统负载不均且不能适应多变的网络环境等诸多问题。实验结果表明,与加权轮询法(WRR)和加权最少连接法(WLC)调度方案相比,该机制能够在并发量较大时维持较低的响应时间,并能够根据集群中综合负载的状态实时地增加或减少虚拟机数量,通常在5s之内达到整体集群的负载均衡。

CLC Number:

TP393

LI Liyao ZHAO Shaoka LIN Dongsen XU Cong YANG Jiahai. Dynamic load balancing mechanism in cloud-based virtual cluster system[J]. Journal of Computer Applications, 2014, 34(11): 3082-3085.

李立耀赵少卡林东森徐聪杨家海. 云环境下虚拟机集群系统动态负载均衡机制[J]. 计算机应用, 2014, 34(11): 3082-3085.

References

[1]RAJKUMAR B, SHIN Y C, VENUGOPAL S, et al.Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility[J]. Future Generation Computer Systems,2009,25(6):599-616.
[2]LUO J, JIN J, SONG A, et al.Cloud computing: architecture and key technologies[J]. Journal on Communications,2011,32(7):3-21.(罗军舟, 金嘉晖, 宋爱波. 云计算:体系架构与关键技术[J]. 通信学报, 2011, 32(7):3-21.)
[3]DU Y, GUO T, CHEN J. Fleet elastic load balancing mechanism in cloud environment[J]. Journal of Computer Applications,2013,33(3):830-833.(杜垚,郭涛,陈俊杰.云环境下机群弹性负载均衡机制[J].计算机应用,2013,33(3):830-833.)
[4]JIAO Y, WANG W. Design and implementation of load balancing of distributed-system-based Web server[C]// Proceedings of the 2010 Third International Symposium on Electronic Commerce and Security. Piscataway: IEEE Press, 2010: 337-342.
[5]GILLY K, JUIZ C, PUIGJANER R. An up-to-date survey in Web load balancing[J]. World Wide Web, 2011, 14(2): 105-131.
[6]SPEITKAMP B, BICHLER M. A mathematical programming approach for server consolidation problems in virtualized data centers[J]. IEEE Transactions on Services Computing,2010,3(4):266-278.
[7]QIN X, XIE T. An availability-aware task scheduling strategy for heterogeneous systems[J]. IEEE Transactions on Computers, 2008,57(2):188-199.
[8]
ZHAO S, LI L, LING X, et al.Architecture and scheduling scheme design of Tsinghua cloud based on OpenStack[J]. Journal of Computer Applications,2013,33(12): 3335-3338.(赵少卡, 李立耀, 凌晓, 等. 基于OpenStack的清华云平台构建与调度方案设计[J]. 计算机应用, 2013, 33(12): 3335-3338.)
[9]MAGULURI S T, SRIKANT R, YING L. Stochastic models of load balancing and scheduling in cloud computing clusters[C]// Proceedings of the 2012 IEEE INFOCOMM. Piscataway: IEEE Press, 2012:702-710.
[10]MAGULURI S T, SRIKANT R, YING L. Heavy traffic optimal resource allocation algorithms for cloud computing clusters[EB/OL]. [2013-10-10]. http://arxiv.org/pdf/1206.1264v1.pdf.
[11]CHEN Y, HUAI J, HU C. Live migration of virtual machines based on hybrid memory copy approach[J]. Chinese Journal of Computers,2011,34(12):2278-2291.(陈阳, 怀进鹏, 胡春明. 基于内存混合复制方式的虚拟机在线迁移机制[J]. 计算机学报, 2011, 34(12): 2278-2291.)
[12]ZHANG W. LVS cluster load dispatch [EB/OL]. [2013-10-10]. http://www.linuxvirtualserver.org/zh/lvs4.html.(章文嵩. LVS集群的负载调度[EB/OL]. [2013-10-10]. http://www.linuxvirtualserver.org/zh/lvs4.html.)
[13]FENG L, FU Y, CHEN K, et al.TDDS: task deployment and scheduling based on virtual cluster system[J]. Journal of Computer Research and Development,2013,50(5):1118-1124.(冯琳, 付勇, 陈康, 等. TDDS: 基于虚拟集群系统的任务部署与调度[J]. 计算机研究与发展, 2013, 50(5): 1118-1124.)
[14]OpenStack installation guide for Ubuntu 12.04 [EB/OL].[2013-12-20].http://docs.openstack.org/havana/install-guide/install/apt/content/.

[1]	ZONG Xuejun, HAN Bing, WANG Guogang, NING Bowei, HE Kan, LIAN Lian. TDRFuzzer: fuzzy testing method for industrial control protocols based on adaptive dynamic interval strategy [J]. Journal of Computer Applications, 0, (): 0-0.
[2]	Ming ZHANG, Le FU, Haifeng WANG. Relay control model for concurrent data flow in edge computing [J]. Journal of Computer Applications, 2024, 44(12): 3876-3883.
[3]	. Survey of DNS tunneling detection technology research [J]. Journal of Computer Applications, 0, (): 0-0.
[4]	. Large scale IoT binary component identification based on named entity recognition [J]. Journal of Computer Applications, 0, (): 0-0.
[5]	Yixi LIU, Jun HE, Bo WU, Bingtong LIU, Ziyu LI. Survey of software security testing techniques in DevSecOps [J]. Journal of Computer Applications, 2024, 44(11): 3470-3478.
[6]	Chuanlin PANG, Rui TANG, Ruizhi ZHANG, Chuan LIU, Jia LIU, Shibo YUE. Distributed power allocation algorithm based on graph convolutional network for D2D communication systems [J]. Journal of Computer Applications, 2024, 44(9): 2855-2862.
[7]	Jiepo FANG, Chongben TAO. Hybrid internet of vehicles intrusion detection system for zero-day attacks [J]. Journal of Computer Applications, 2024, 44(9): 2763-2769.
[8]	ZHANG Yiming, CAO Tengfei. Federated Learning Optimization Algorithm based on Local Drift and Diversity Computing Power [J]. Journal of Computer Applications, 0, (): 0-0.
[9]	Hang XU, Zhi YANG, Xingyuan CHEN, Bing HAN, Xuehui DU. Coverage-guided fuzzing based on adaptive sensitive region mutation [J]. Journal of Computer Applications, 2024, 44(8): 2528-2535.
[10]	Hong CHEN, Bing QI, Haibo JIN, Cong WU, Li’ang ZHANG. Class-imbalanced traffic abnormal detection based on 1D-CNN and BiGRU [J]. Journal of Computer Applications, 2024, 44(8): 2493-2499.
[11]	GENG Haijun, DONG Yun, HU Zhiguo, CHI Haotian, YANG Jing, YIN Xia. Encrypted traffic classification method based on Attention-1DCNN-CE#br# #br# [J]. Journal of Computer Applications, 0, (): 0-0.
[12]	. Summary of network intrusion detection systems based on deep learning [J]. Journal of Computer Applications, 0, (): 0-0.
[13]	CHEN Ruilong, HU Tao, BU Youjun, YI Peng, HU Xianjun, QIAO Wei. Stacking ensemble adversarial defense method for encrypted malicious traffic detection model [J]. Journal of Computer Applications, 0, (): 0-0.
[14]	Zhongdai WU, Dezhi HAN, Haibao JIANG, Cheng FENG, Bing HAN, Chongqing CHEN. Review of marine ship communication cybersecurity [J]. Journal of Computer Applications, 2024, 44(7): 2123-2136.
[15]	Zihao YAO, Yuanming LI, Ziqiang MA, Yang LI, Lianggen WEI. Multi-object cache side-channel attack detection model based on machine learning [J]. Journal of Computer Applications, 2024, 44(6): 1862-1871.

Dynamic load balancing mechanism in cloud-based virtual cluster system

云环境下虚拟机集群系统动态负载均衡机制

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics