公有云存储系统性能评测方法研究

doi:10.11772/j.issn.1001-9081.2017.05.1229

计算机应用 ›› 2017, Vol. 37 ›› Issue (5): 1229-1235.DOI: 10.11772/j.issn.1001-9081.2017.05.1229

• 第22届全国信息存储技术学术会议 • 上一篇下一篇

公有云存储系统性能评测方法研究

李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南

西北工业大学计算机学院, 西安 710129

收稿日期:2016-07-15 修回日期:2016-11-16 出版日期:2017-05-10 发布日期:2017-05-16
通讯作者: 李阿妮
作者简介:李阿妮(1992-),女,陕西咸阳人,硕士研究生,主要研究方向:云计算、云存储;张晓(1978-),男,河南新乡人,副教授,博士,CCF会员,主要研究方向:云计算、云存储、海量存储;张伯阳(1990-),男,陕西西安人,硕士研究生,主要研究方向:云计算、云存储;柳春懿(1993-),男,安徽蚌埠人,硕士研究生,主要研究方向:云计算、云存储;赵晓南(1979-),女,东北吉林人,讲师,博士,CCF会员,主要研究方向:云计算、云存储、海量存储。
基金资助:
国家863计划项目（2015AA015307）；国家自然科学基金面上项目（61472323）；中央高校基本科研业务费专项（3102015JSJ0009）；国家自然科学基金青年科学基金资助项目（61502392）。

Research on performance evaluation method of public cloud storage system

LI Ani, ZHANG Xiao, ZHANG Boyang, LIU Chunyi, ZHAO Xiaonan

School of Computer Science, Northwestern Polytechnical University, Xi'an Shaanxi 710129, China

Received:2016-07-15 Revised:2016-11-16 Online:2017-05-10 Published:2017-05-16
Supported by:
This work is partially supported by the National High Technology Research and Development Program (863 Program) of China (2015AA015307), the National Natural Science Foundation of China General Program (61472323), the Fundamental Research Funds for the Central Universities (3102015JSJ0009), the National Natural Science Foundation for Distinguished Young Scholars of China (61502392).

摘要/Abstract

摘要： 随着云存储系统的迅速发展和广泛使用，许多企业开发者和个人用户将其应用从传统存储迁移至公有云存储系统，因此，云存储系统性能成为企业开发者和个人用户关注的焦点。由于传统测试难以模拟足够多的用户同时访问云存储系统；测试环境构建复杂，测试时间长，准备测试环境成本高；受网络因素及外界其他因素影响，评测结果不稳定。针对以上所述云存储系统性能评测的重点和难点，提出一种“云测试云”的公有云存储系统性能评测方法，该方法通过在云计算平台动态申请足够数量的实例，对公有云存储系统性能进行评测。首先，构建通用的性能评测框架，可动态伸缩申请实例，自动化部署评测工具及负载，控制并发访问云存储系统，自动释放实例及收集并反馈评测结果；其次，提出多维度的性能评测指标，涵盖不同典型应用、不同云存储接口；最后，提出一种可扩展通用的性能评测模型，该模型可以评测常见典型应用的性能，分析云存储性能影响因素，可适用于任何的公有云存储平台。为了验证该方法的可行性、合理性、通用性和可扩展性，利用所提方法对Amazon S3云存储系统进行性能评测，并使用s3cmd验证评测结果的准确性。实验结果表明，评测结果可以为企业开发者和个人用户提供参考意见。

关键词: 云测试云, 公有云存储系统, 性能评测, Amazon S3, 自动化评测工具

Abstract: With the rapid development and wide application of cloud storage system, many enterprise developers and individual users migrate their applications from traditional storage to public cloud storage system. Therefore, the performance of cloud storage system has become the focus of enterprise developers and individual users. The traditional test is difficult to simulate simultaneous access with enough users to the cloud storage system, complex to build and has a long test time with high cost. Besides, the evaluation results are unstable due to the network and other outside factors. In view of above critical problems, a kind of "cloud testing cloud" performance evaluation method was put forward for public cloud storage system. Public cloud storage system was evaluated by this method through applying a sufficient number of instances on the cloud computing platform. Firstly, a general performance evaluation framework was built with abilities such as dynamic instance application, automated deployment of assessment tools and load, controlling concurrent access to cloud storage system, automated instance release and evaluation results collection and feedback. Secondly, some multi-dimensional performance evaluation indicators were presented, covering different typical applications and different cloud storage interfaces. Finally, an extensible general performance evaluation model was put forward, which could evaluate the performance of typical applications, analyze the factors influencing cloud storage performance and be applied to any public cloud storage platform. In order to verify the feasibility, rationality, universality and expansibility of this method, these presented methods were applied to evaluate Amazon S3 cloud storage system, and then the accuracy of the evaluation results was verified by s3cmd. The results show that the evaluation output can provide reference comments for enterprise developers and individual users.

Key words: cloud testing cloud, public cloud storage system, performance evaluation, Amazon S3, automated evaluation tool

中图分类号:

TP301

李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南. 公有云存储系统性能评测方法研究[J]. 计算机应用, 2017, 37(5): 1229-1235.

LI Ani, ZHANG Xiao, ZHANG Boyang, LIU Chunyi, ZHAO Xiaonan. Research on performance evaluation method of public cloud storage system[J]. Journal of Computer Applications, 2017, 37(5): 1229-1235.

参考文献

[1] 张龙立.云存储技术探讨[J].电信科学,2010,26(8A):71-74. (ZHANG L L. Cloud storage technology study[J]. Telecommunications Science, 2010, 26(8A):71-74.)
[2] HILL Z, LI J, MAO M, et al. Early observations on the performance of Windows Azure[J]. Scientific Programming, 2011, 19(2/3):121-132.
[3] AGARWAL D, PRASAD S K. AzureBench:Benchmarking the storage services of the Azure cloud platform[C]//Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum. Washington, DC:IEEE Computer Society, 2012:1048-1057.
[4] PALANKAR M R, IAMNITCHI A, RIPEANU M, et al. Amazon S3 for science grids:a viable solution?[C]//Proceedings of the 2008 International Workshop on Data-aware Distributed Computing. New York:ACM, 2008:55-64.
[5] GARFINKEL S L. An evaluation of Amazon's grid computing services:EC2, S3 and SQS, TR-08-07[R]. Cambridge:Harvard University, School for Engineering and Applied Sciences, 2007.
[6] GARFINKEL S. Commodity grid computing with Amazon's S3 and EC2[EB/OL].[2016-10-20].http://www.dtic.mil/dtic/tr/fulltext/u2/a486666.pdf.
[7] 周小鹏,张小芳,赵晓南. 云存储性能评测研究[J]. 计算机科学, 2014, 41(4):190-194.(ZHOU X P, ZHANG X F, ZHAO X N. Cloud storage performance evaluation research[J]. Computer Science, 2014, 41(4):190-194.)
[8] 何思敏,康慕宁,张晓,等. 云存储性能评测技术与方法研究[J]. 计算机与现代化, 2011(12):1-4. (HE S M, KANG M N, ZHANG X, et al. Cloud storage performance evaluation technology and method research[J].Computer and Modernization, 2011(12):1-4.)
[9] 齐婵颖, 李战怀, 张晓, 等. 云存储系统性能评测技术研究[J]. 计算机研究与发展, 2014, 51(S1):223-228. (QI C Y, LI Z H, ZHANG X, et al. The research of cloud storage system performance evaluation[J]. Journal of Computer Research and Development, 2014, 51(S1):223-228.)
[10] TUDORAN R, COSTAN A, ANTONIU G, et al. A performance evaluation of Azure and Nimbus clouds for scientific applications[C]//Proceedings of the 2nd International Workshop on Cloud Computing Platforms. New York:ACM, 2012:Article No. 4.
[11] COOPER B F, SILBERSTEINS A, TAM E, et al. Benchmarking cloud serving systems with YCSB[C]//Proceedings of the 1st ACM Symposium on Cloud Computing. New York:ACM, 2010:143-154.
[12] SHIVAM P, MARUPADI V, CHASE J S, et al. Cutting corners:workbench automation for server benchmarking[C]//Proceedings of USENIX 2008 Annual Technical Conference. Berkeley, CA:USENIX Association, 2008:241-254.
[13] 云存储[EB/OL].[2016-05-15]. http://www.hostucan.cn/cloud-storage. (Cloud storage[EB/OL].[2016-05-15]. http://www.hostucan.cn/cloud-storage.)

公有云存储系统性能评测方法研究

Research on performance evaluation method of public cloud storage system

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 1

编辑推荐

Metrics