主动容错云存储系统的可靠性评价模型

doi:10.11772/j.issn.1001-9081.2018020502

计算机应用 ›› 2018, Vol. 38 ›› Issue (9): 2631-2636.DOI: 10.11772/j.issn.1001-9081.2018020502

主动容错云存储系统的可靠性评价模型

李静¹, 刘冬实²

1. 中国民航大学计算机科学与技术学院, 天津 300300;
2. 南开大学计算机与控制工程学院, 天津 300500

收稿日期:2018-03-13 修回日期:2018-04-24 出版日期:2018-09-10 发布日期:2018-09-06
通讯作者: 李静
作者简介:李静(1982—),女,山东德州人,讲师,博士,主要研究方向:大规模数据存储、机器学习;刘冬实(1994—),男,辽宁绥中人,硕士研究生,主要研究方向:机器学习、数据挖掘。
基金资助:
国家青年自然科学基金资助项目（61702521）；中国民航大学科研启动基金资助项目（2017QD03S）。

Reliability evaluation model for cloud storage systems with proactive fault tolerance

LI Jing¹, LIU Dongshi²

1. College of Computer Science and Technology, Civil Aviation University of China, Tianjin 300300, China;
2. College of Computer and Control Engineering, Nankai University, Tianjin 300500, China

Received:2018-03-13 Revised:2018-04-24 Online:2018-09-10 Published:2018-09-06
Contact: 李静
Supported by:
This work is partially supported by National Youth Natural Science Foundation (61702521), Scientific Research Startup Fund of Civil Aviation University of China (2017QD03S).

摘要/Abstract

摘要： 除了传统的冗余机制，主动容错技术也被用来提高存储系统的可靠性。然而，当前对主动容错云存储系统可靠性的研究工作很少，而且都局限于硬盘故障服从指数分布的假设前提。针对主动容错磁盘冗余阵列RAID-5和RAID-6云存储系统提出两个可靠性状态转移模型，并基于转移模型设计了蒙特卡洛仿真算法，评价系统在一定运行周期内发生数据丢失事件的期望个数。该算法采用韦布分布函数模拟随时间变化（降低、恒定不变、或升高）的硬盘故障率，准确评价了主动容错机制、硬盘整体故障、故障修复、潜在块故障以及磁盘清洗过程对系统可靠性的影响。所提方法可以帮助系统设计者评估不同容错机制和系统参数对云存储系统可靠性的影响，有助于创建高可靠存储系统。

关键词: 主动容错, 云存储系统, 蒙特卡洛仿真, 可靠性评价, 韦布分布

Abstract: In addition to traditional reactive fault-tolerant technologies, proactive fault tolerance can be used to improve storage system reliability significantly. There is few research on reliability of proactive cloud storage systems, supposing exponential distribution of drive failure. Two reliability state transfer models were developed for proactive redundant arrays of independent disks RAID-5 and RAID-6 systems respectively. Based on the models, Monte Carlo simulations were designed to estimate the expected number of data-loss events in proactive RAID-5 and RAID-6 systems within a given time period. Weibull distribution was used to model time-based (decreasing, constant occurrence, or increasing) disk failure rates, and express the impact of proactive fault tolerance, operational failures, failure restoration, latent block defects, and drive scrubbing on the system's reliability. The proposed method can help system designers to evaluate the impact of different fault tolerance mechanisms and system parameters on the reliability of cloud storage systems, and help to create highly reliable storage systems.

Key words: proactive fault tolerance, cloud storage system, Monte Carlo simulation, reliability evaluation, Weibull distribution

中图分类号:

TP302

李静, 刘冬实. 主动容错云存储系统的可靠性评价模型[J]. 计算机应用, 2018, 38(9): 2631-2636.

LI Jing, LIU Dongshi. Reliability evaluation model for cloud storage systems with proactive fault tolerance[J]. Journal of Computer Applications, 2018, 38(9): 2631-2636.

参考文献

[1] VISHWANATH K V, NAGAPPAN N. Characterizing cloud computing hardware reliability[C]//SoCC'10:Proceedings of the 1st ACM symposium on Cloud Computing. New York:ACM, 2010:193-204.
[2] LI J, JI X, JIA Y, et al. Hard drive failure prediction using classification and regression trees[C]//DSN'14:Proceedings of the 201444th Annual IEEE/IFIP International Conference on Dependable Systems and Networks. Washington, DC:IEEE Computer Society, 2014:383-394.
[3] RINCÓN C C A, PÂRIS J F, VILALTA R, et al. Disk failure prediction in heterogeneous environments[EB/OL].[2017-12-12]. http://www2.cs.uh.edu/~vilalta/papers/2017/spects17.pdf.
[4] ECKART B, CHEN X, HE X, et al. Failure prediction models for proactive fault tolerance within storage systems[C]//Proceedings of the 2008 IEEE International Symposium on Modeling, Analysis and Simulation of Computers and Telecommunication Systems. Piscataway, NJ:IEEE, 2008:1-8
[5] LI J, LI M, WANG G, et al. Global reliability evaluation for cloud storage systems with proactive fault tolerance[C]//Proceedings of the 2015 International Conference on Algorithms and Architectures for Parallel Processing, LNCS 9531. Berlin:Springer, 2015:189-203.
[6] SCHROEDER B, GIBSON G A. Disk failures in the real world:what does an MTTF of 1000000 hours mean to you? (CMU-PDL-06-111)[EB/OL].[2017-12-12]. http://xueshu.baidu.com/s?wd=paperuri%3A%28242276ecc5a40ab0267e74d64ceacf4e%29&filter=sc_long_sign&tn=SE_xueshusource_2kduw22v&sc_vurl=http%3A%2F%2Fciteseerx.ist.psu.edu%2Fviewdoc%2Fdownload%3Fdoi%3D10.1.1.903.2189%26rep%3Drep1%26type%3Dpdf&ie=utf-8&sc_us=1664363059554820.
[7] DHOLAKIA A, ELEFTHERIOU E, HU X Y, et al. A new intra-disk redundancy scheme for high-reliability RAID storage systems in the presence of unrecoverable errors[J]. ACM Transactions on Storage, 2008, 4(1):Article No. 1.
[8] GREENAN K M, MILLER E L, WYLIE J J. Reliability of flat XOR-based erasure codes on heterogeneous devices[C]//Proceedings of the 2008 IEEE International Conference on Dependable Systems and Networks with FTCS and DCC. Piscataway, NJ:IEEE, 2008:147-156.
[9] GIBSON G A. Redundant disk arrays:reliable, parallel secondary storage[D]. Berkeley, CA:University of California at Berkeley, 1992.
[10] 章宏灿,薛巍.集群RAID5存储系统可靠性分析[J]. 计算机研究与发展,2010,47(4):727-735.(ZHANG H C, XUE W. Reliability analysis of cluster RAID5 storage system[J]. Journal of Computer Research and Development, 2010, 47(4):727-735.)
[11] 穆飞,薛巍,舒继武,等.一种面向大规模副本存储系统的可靠性模型[J].计算机研究与发展,2009,46(5):756-761.(MU F, XUE W, SHU J W, et al. An analytical model for large-scale storage system with replicated data[J]. Journal of Computer Research and Development, 2009, 46(5):756-761.)
[12] YU L, MILLER A A, HOFFMANN R, et al. Towards the automated verification of Weibull distributions for system failure rates[C]//Proceedings of the 2016 International Workshop on Formal Methods for Industrial Critical Systems, LNCS 9933. Berlin:Springer, 2016:81-96.
[13] ELERATH J G, SCHINDLER J. Beyond MTTDL:a closed-form RAID 6 reliability equation[J]. ACM Transactions on Storage, 2014, 10(2):Article No. 7.
[14] ELERATH J G. A simple equation for estimating reliability of an N+1 Redundant Array of Independent Disks (RAID)[C]//DSN'09:Proceedings of the 2009 IEEE/IFIP International Conference on Dependable Systems and Networks. Piscataway, NJ:IEEE, 2009:484-493.
[15] EPSTEIN A, KOLODNER E K, SOTNIKOV D. Network aware reliability analysis for distributed storage systems[C]//Proceedings of the 2016 IEEE 35th Symposium on Reliable Distributed Systems. Washington, DC:IEEE Computer Society, 2016:249-258.
[16] HALL R J. Tools for predicting the reliability of large-scale storage systems[J]. ACM Transactions on Storage, 2016, 12(4):Article No. 24.
[17] ALLEN B. Monitoring hard disks with smart[J]. Linux Journal, 2004, 2004(117):9.
[18] 罗象宏,舒继武.存储系统中的纠删码研究综述[J].计算机研究与发展,2012,49(1):1-11.(LUO X H, SHU J W. Summary of research for erasure code in storage system[J]. Journal of Computer Research and Development, 2012, 49(1):1-11.)
[19] ELERATH J G. Specifying reliability in the disk drive industry:No more MTBF's[C]//Proceedings of the 2000 International Symposium on Product Quality and Integrity, Reliability and Maintainability Symposium. Piscataway, IEEE, 2000:194-199.
[20] McCOOL J I. Using the weibull distribution:reliability, modeling and inference[J]. Journal of Applied Statistics, 2012, 41(4):913-914.

主动容错云存储系统的可靠性评价模型

Reliability evaluation model for cloud storage systems with proactive fault tolerance

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 4

编辑推荐

Metrics

[1]	李静, 罗金飞, 李炳超. 主动容错副本存储系统的可靠性分析模型[J]. 计算机应用, 2021, 41(4): 1113-1121.
[2]	李阿妮, 张晓, 张伯阳, 柳春懿, 赵晓南. 公有云存储系统性能评测方法研究[J]. 计算机应用, 2017, 37(5): 1229-1235.
[3]	廖辉, 薛广涛, 钱诗友, 李明禄. 基于纠删码的细粒度云存储调度方案[J]. 计算机应用, 2017, 37(3): 613-619.
[4]	吕堂祺黄宁贾晓光王东. 面向服务架构软件实现前的可靠性评价方法[J]. 计算机应用, 2011, 31(09): 2436-2439.