基于数据分类存储的云存储系统节能算法

doi:10.11772/j.issn.1001-9081.2014.08.2267

计算机应用 ›› 2014, Vol. 34 ›› Issue (8): 2267-2272.DOI: 10.11772/j.issn.1001-9081.2014.08.2267

基于数据分类存储的云存储系统节能算法

张陶¹,廖彬²,孙华³,李丰军¹,姬金虎¹

1. 新疆医科大学医学工程技术学院，乌鲁木齐830011；
2. 新疆财经大学统计与信息学院，乌鲁木齐830012；
3. 新疆大学软件学院，乌鲁木齐830008

收稿日期:2014-03-05 修回日期:2014-04-22 出版日期:2014-08-01 发布日期:2014-08-10
通讯作者: 廖彬
作者简介:张陶(1988-),女,新疆乌鲁木齐人,硕士,主要研究方向：分布式计算、网格计算；廖彬(1986-),男,四川内江人,博士,主要研究方向：数据库、云计算、绿色计算；孙华(1977-),女,新疆乌鲁木齐人,副教授，博士,主要研究方向：信息安全、信誉管理；李丰军（1976-），男,山东泰安人,讲师,硕士研究生,主要研究方向：云计算、分布式计算；姬金虎(1979-)，男，新疆乌鲁木齐人,讲师,硕士研究生,主要研究方向：云计算、分布式计算。
基金资助:
国家自然科学基金资助项目;新疆大学博士启动基金资助项目

Energy-efficient algorithm based on data classification for cloud storage system

ZHANG Tao¹,LIAO Bin²,SHUN Hua³,LI Fengjun¹,JI Jinhu¹

1. Medical Engineering College, Xinjiang Medical University, Urumqi Xinjiang 830011, China;
2. College of Statistics and Information, Xinjiang University of Finance and Economics, Urumqi Xinjiang 830012, China;
3. School of Software, Xinjiang University, Urumqi Xinjiang 830008, China

Received:2014-03-05 Revised:2014-04-22 Online:2014-08-01 Published:2014-08-10
Contact: LIAO Bin

摘要/Abstract

摘要：

云存储规模的不断扩大以及设计时对能耗因素的忽略使其日益暴露出高能耗低效率的问题，并且此问题已经成为制约云计算与大数据快速发展的一个主要瓶颈。已有研究大多采用将整个存储节点调整到低能耗模式以达到节能的目的。根据数据的重复性及访问规律，设计了基于数据分类的存储模型，将存储区域划分为热数据块区、冷数据块区与重复文件区，根据不同数据的重复性及活动因子特点进行分区存储。围绕新的存储模型，设计了适应节能的数据存储算法并建立了能耗模型。实验结果表明：当系统负载小于设定阈值时，新的存储模型能够提高存储系统25%左右的能耗利用率。

Abstract:

Constant expansion and that energy consumption factors are ignored with its design process, bring the problem of high energy consumption and low efficiency of the cloud storage system. And this problem has become a main bottleneck in the development of cloud computing and big data. Most of previous studies had been mostly used to adjust the entire storage node to the low-power mode to save energy. According to the repetition of data and access rules, new storage model based on data classification was proposed. The storage area was divided into HotZone, ColdZone and ReduplicationZone so as to divisionally store the data according to the repetition and activity factor characteristics of each data file. Based on the new storage model, an energy-efficient storage algorithm was designed and a new storage model was constructed. The experimental results show that, the new storage model improves the energy utilization rate of the distributed storage system nearly 25%, especially when the system load is lower than the given threshold.

中图分类号:

张陶廖彬孙华李丰军姬金虎. 基于数据分类存储的云存储系统节能算法[J]. 计算机应用, 2014, 34(8): 2267-2272.

ZHANG Tao LIAO Bin SHUN Hua LI Fengjun JI Jinhu. Energy-efficient algorithm based on data classification for cloud storage system[J]. Journal of Computer Applications, 2014, 34(8): 2267-2272.

参考文献

［1］GANTZ J, CHUTE C, MANFREDIZ A, et al. The diverse and exploding digital universe: an updated forecast of worldwide information growth through 2011 ［EB/OL］. ［2013-05-25］. http://wwww.ifap.ru/library/book268.pdf.
［2］MENG X, CI X. Big data management: concepts, techniques and challenges ［J］. Journal of Computer Research and Development, 2013: 50(1): 146-149.(孟小峰,慈祥.大数据管理:概念、技术与挑战［J］.计算机研究与发展,2013,50(1):146-149.)
［3］Global action plan, an inefficient truth ［EB/OL］. ［2011-02-12］. http://globalactionplan.org.uk.
［4］TIMES N Y. Power, pollution and the Internet ［EB/OL］. ［2013-05-20］. http://www.nytimes.com/2012/09/23/technology/data-ceneters-waste-vast-amounts-of-energy-belying-industry-image.html.
［5］U.S. Environmental Protection Agency. EPA report on server and data center energy efficiency ［EB/OL］. ［2014-01-18］. http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency_study.
［6］BATTLES B, BELLEVILLE C, GRABAU S, et al. Reducing data center power consumption through efficient storage ［EB/OL］. ［2014-01-05］. http://bnrg.eecs.berkeley.edu/~randy/Courses/CS294.F07/NetApp2.pdf.
［7］WANG X, WANG Y. Coordinating power control and performance management for virtualized server cluster ［J］. IEEE Transactions on Parallel and Distributed Systems, 2011, 22(2): 245-259.
［8］SONG Y, WANG H, LI Y, et al. Multi-tiered on-demand resource scheduling for VM-based data center ［C］// CCGRID 2009: Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid. Washington, DC: IEEE Computer Society: 148-155.
［9］LIAO B, YU J, ZHANG T, et al. Energy-efficient algorithms for distributed file system HDFS ［J］. Chinese Journal of Computers, 2013, 36(5): 1047-1064.(廖彬,于炯,张陶,等.基于分布式文件系统HDFS的节能算法［J］.计算机学报,2013,36(5):1047-1064.)
［10］LIAO B, YU J, SUN H, et al. Energy-efficient algorithms for distributed storage system based on data storage structure reconfiguration ［J］. Journal of Computer Research and Development, 2013, 50(1): 3-18.(廖彬,于炯,孙华,等.基于存储结构重配置的分布式存储系统节能算法［J］.计算机研究与发展,2013,50(1):3-18.)
［11］PINHEIRO E, BIANCHINI R, DUBNICKI C. Exploiting redun-dancy to conserve energy in storage systems ［C］// Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems. New York: ACM Press, 2006: 15-26.
［12］COLARELLI D, GRUNWALD D. Massive arrays of idle disks for storage archives ［C］// Proceedings of the 2002 ACM/IEEE Conference on Supercomputing. Washington, DC: IEEE Computer Society, 2002:1-11.
［13］HARNIK D, NAOR D, SEGALL I. Low power mode in cloud storage systems ［C］// IPDPS 2009: Proceedings of the 2009 IEEE International Symposium on Parallel and Distributed Processing. Piscataway: IEEE Press, 2009: 1-8.
［14］LEVERICH J, KOZYRAKIS C. On the energy (in) efficiency of Hadoop clusters ［J］. ACM SIGOPS Operating Systems Review. 2010, 44(1): 61-65.
［15］NITESH M, NANDURI R, VARMA V. Dynamic energy efficient data placement and cluster reconfiguration algorithm for MapReduce framework ［J］. Future Generation Computer Systems, 2011, 28(1): 119-127.
［16］NARAYANAN D, DONNELLY A, ROWSTRON A. Write off-loading: practical power management for enterprise storage ［J］. ACM Transactions on Storage, 2008, 4(3): 253-267.
［17］HAMILTON J. Cooperative Expendable Micro-Slice Servers (CEMS): low cost, low power servers for Internet-scale services ［EB/OL］. ［2014-01-11］. http://www.mvdirona.com/jrh/talksandpapers/jameshamilton_cems.pdf.
［18］VASUDEVAN V, FRANKLIN J, ANDERSEN D, et al. FAWNdamentally power-efficient clusters ［C］// Proceedings of the 12th Conference on Hot Topics in Operating Systems. Berkeley: USENIX Association, 2009: 22.
［19］SZALAYY A S, BELL G, HUANGZ H H, et al. Low-power Amdahl-balanced blades for data intensive computing ［J］. ACM SIGOPS Operating Systems Review, 2009, 44(1): 71-75.
［20］LIM K, RANGANATHAN P, CHANG J, et al. Understanding and designing new server architectures for emerging warehouse-computing environments ［C］// Proceedings of the 35th Annual International Symposium on Computer Architecture. Washington, DC: IEEE Computer Society, 2008: 315-326.
［21］McKNIGHT J, ASARO T, BABINEAU B. Digital archiving: end-user survey and market forecast 2006—2010 ［EB/OL］. ［2013-05-25］. http://www.enterprisestrategygroup.com/ESGPublications/ReportDetail.asp?ReportID=591.
［22］CALHEIROS R N, RANJAN R, BELOGLAZOV A, et al. CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms ［J］. Software: Practice and Experience, 2010, 41(1): 23-50.

[1]	谢兆贤燕晶吴欣悦黄沈权. 基于深层树状网页结构的循环网页机制[J]. 计算机应用, 0, (): 0-0.
[2]	蔡豪, 袁正道. 云数据中心基于贪心模式的虚拟机选择算法[J]. 计算机应用, 2020, 40(6): 1707-1713.
[3]	刘惠剑, 刘峻松, 王佳伟, 薛岗. 基于过程划分技术的服务组合拆分方法[J]. 计算机应用, 2020, 40(3): 799-805.
[4]	丁宁, 管新荣, 杨炜伟, 李彤凯, 王建设. 非完美信道估计条件下多比特量化无线密钥生成性能分析[J]. 计算机应用, 2020, 40(1): 143-147.
[5]	蔡豪袁正道. 云数据中心基于贪心模式的虚拟机选择算法[J]. 计算机应用, 0, (): 0-0.
[6]	刘开南. 云数据中心基于贪心算法的虚拟机迁移策略[J]. 计算机应用, 2019, 39(11): 3333-3338.
[7]	林立, 熊金波, 肖如良, 林铭炜, 陈秀华. Gaming@Edge:基于边缘节点的低延迟云游戏系统[J]. 计算机应用, 2019, 39(7): 2001-2007.
[8]	徐雅斌, 彭宏恩. 基于需求预测的PaaS平台资源分配方法[J]. 计算机应用, 2019, 39(6): 1583-1588.
[9]	丁宁, 管新荣, 杨炜伟. 基于通用软件无线电外设的OFDM信道物理密钥量化分析[J]. 计算机应用, 2019, 39(6): 1780-1785.
[10]	盛俊, 顾沈胜, 陈崚. 基于隐空间映射的带符号网络上的顶点分类[J]. 计算机应用, 2019, 39(5): 1411-1415.
[11]	李磊, 薛洋, 吕念玲, 冯敏. 基于李雅普诺夫优化的容器云队列在线任务和资源调度设计[J]. 计算机应用, 2019, 39(2): 494-500.
[12]	冬欣松, 郑建超, 蔡跃明, 尹廷辉, 张潇毅. 端到端通信中基于时间转换能量采集的计算迁移方案[J]. 计算机应用, 2018, 38(12): 3535-3540.
[13]	李磊1*,薛洋1,吕念玲1,冯敏2. 基于李雅普诺夫优化的容器云队列在线任务和资源调度设计[J]. 计算机应用, 0, (): 0-0.
[14]	冬欣松郑建超蔡跃明尹廷辉张潇毅. D2D通信中基于时间转换能量采集的计算迁移方法[J]. 计算机应用, 0, (): 0-0.
[15]	方文浩, 陆阳, 卫星. 基于区域判定的超宽带井下高精度定位[J]. 计算机应用, 2018, 38(7): 1989-1994.

基于数据分类存储的云存储系统节能算法

Energy-efficient algorithm based on data classification for cloud storage system

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics