Abstract：With the rapid development and wide application of cloud storage system, many enterprise developers and individual users migrate their applications from traditional storage to public cloud storage system. Therefore, the performance of cloud storage system has become the focus of enterprise developers and individual users. The traditional test is difficult to simulate simultaneous access with enough users to the cloud storage system, complex to build and has a long test time with high cost. Besides, the evaluation results are unstable due to the network and other outside factors. In view of above critical problems, a kind of "cloud testing cloud" performance evaluation method was put forward for public cloud storage system. Public cloud storage system was evaluated by this method through applying a sufficient number of instances on the cloud computing platform. Firstly, a general performance evaluation framework was built with abilities such as dynamic instance application, automated deployment of assessment tools and load, controlling concurrent access to cloud storage system, automated instance release and evaluation results collection and feedback. Secondly, some multi-dimensional performance evaluation indicators were presented, covering different typical applications and different cloud storage interfaces. Finally, an extensible general performance evaluation model was put forward, which could evaluate the performance of typical applications, analyze the factors influencing cloud storage performance and be applied to any public cloud storage platform. In order to verify the feasibility, rationality, universality and expansibility of this method, these presented methods were applied to evaluate Amazon S3 cloud storage system, and then the accuracy of the evaluation results was verified by s3cmd. The results show that the evaluation output can provide reference comments for enterprise developers and individual users.
李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南. 公有云存储系统性能评测方法研究[J]. 计算机应用, 2017, 37(5): 1229-1235.
LI Ani, ZHANG Xiao, ZHANG Boyang, LIU Chunyi, ZHAO Xiaonan. Research on performance evaluation method of public cloud storage system. Journal of Computer Applications, 2017, 37(5): 1229-1235.
[1] 张龙立.云存储技术探讨[J].电信科学,2010,26(8A):71-74. (ZHANG L L. Cloud storage technology study[J]. Telecommunications Science, 2010, 26(8A):71-74.) [2] HILL Z, LI J, MAO M, et al. Early observations on the performance of Windows Azure[J]. Scientific Programming, 2011, 19(2/3):121-132. [3] AGARWAL D, PRASAD S K. AzureBench:Benchmarking the storage services of the Azure cloud platform[C]//Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum. Washington, DC:IEEE Computer Society, 2012:1048-1057. [4] PALANKAR M R, IAMNITCHI A, RIPEANU M, et al. Amazon S3 for science grids:a viable solution?[C]//Proceedings of the 2008 International Workshop on Data-aware Distributed Computing. New York:ACM, 2008:55-64. [5] GARFINKEL S L. An evaluation of Amazon's grid computing services:EC2, S3 and SQS, TR-08-07[R]. Cambridge:Harvard University, School for Engineering and Applied Sciences, 2007. [6] GARFINKEL S. Commodity grid computing with Amazon's S3 and EC2[EB/OL].[2016-10-20].http://www.dtic.mil/dtic/tr/fulltext/u2/a486666.pdf. [7] 周小鹏,张小芳,赵晓南. 云存储性能评测研究[J]. 计算机科学, 2014, 41(4):190-194.(ZHOU X P, ZHANG X F, ZHAO X N. Cloud storage performance evaluation research[J]. Computer Science, 2014, 41(4):190-194.) [8] 何思敏,康慕宁,张晓,等. 云存储性能评测技术与方法研究[J]. 计算机与现代化, 2011(12):1-4. (HE S M, KANG M N, ZHANG X, et al. Cloud storage performance evaluation technology and method research[J].Computer and Modernization, 2011(12):1-4.) [9] 齐婵颖, 李战怀, 张晓, 等. 云存储系统性能评测技术研究[J]. 计算机研究与发展, 2014, 51(S1):223-228. (QI C Y, LI Z H, ZHANG X, et al. The research of cloud storage system performance evaluation[J]. Journal of Computer Research and Development, 2014, 51(S1):223-228.) [10] TUDORAN R, COSTAN A, ANTONIU G, et al. A performance evaluation of Azure and Nimbus clouds for scientific applications[C]//Proceedings of the 2nd International Workshop on Cloud Computing Platforms. New York:ACM, 2012:Article No. 4. [11] COOPER B F, SILBERSTEINS A, TAM E, et al. Benchmarking cloud serving systems with YCSB[C]//Proceedings of the 1st ACM Symposium on Cloud Computing. New York:ACM, 2010:143-154. [12] SHIVAM P, MARUPADI V, CHASE J S, et al. Cutting corners:workbench automation for server benchmarking[C]//Proceedings of USENIX 2008 Annual Technical Conference. Berkeley, CA:USENIX Association, 2008:241-254. [13] 云存储[EB/OL].[2016-05-15]. http://www.hostucan.cn/cloud-storage. (Cloud storage[EB/OL].[2016-05-15]. http://www.hostucan.cn/cloud-storage.)
2017, Vol. 37 
