基于磁盘和固态硬盘的混合存储系统研究综述

doi:10.11772/j.issn.1001-9081.2017.05.1217

计算机应用 ›› 2017, Vol. 37 ›› Issue (5): 1217-1222.DOI: 10.11772/j.issn.1001-9081.2017.05.1217

• 第22届全国信息存储技术学术会议 • 下一篇

基于磁盘和固态硬盘的混合存储系统研究综述

陈震, 刘文洁, 张晓, 卜海龙

西北工业大学计算机学院, 西安 710129

收稿日期:2016-07-15 修回日期:2016-12-06 出版日期:2017-05-10 发布日期:2017-05-16
通讯作者: 陈震
作者简介:陈震(1991-),男,安徽安庆人,硕士研究生,主要研究方向:云存储、海量存储;刘文洁(1976-),女,陕西西安人,副教授,博士,主要研究方向:云计算、大数据处理、海量分布式数据库;张晓(1978-),男,陕西西安人,副教授,博士,主要研究方向:云存储、海量存储;卜海龙(1989-),男,陕西韩城人,硕士研究生,主要研究方向:云存储、海量存储。
基金资助:
国家自然科学基金青年科学基金资助项目（61303037）；国家863计划项目（2015AA015307）；国家自然科学基金资助项目（61472323）；中央高校基本科研业务费专项（3102015JSJ0009）。

Review on HDD-SSD hybrid storage

CHEN Zhen, LIU Wenjie, ZHANG Xiao, BO Hailong

School of Computer Science, Northwestern Polytechnical University, Xi'an Shaanxi 710129, China

Received:2016-07-15 Revised:2016-12-06 Online:2017-05-10 Published:2017-05-16
Supported by:
This work is partially supported by Science fund for youths (61303037), the National High Technology Research and Development Program (863 Program) of China (2015AA015307), the National Natural Science Foundation of China (61472323), the Fundamental Research Funds for the Central Universities (3102015JSJ0009).

摘要/Abstract

摘要： 大数据和云计算环境下海量增长的数据对存储系统的超高容量和体系结构带来了极大的挑战。目前存储系统的发展趋向于大容量、低成本和高性能，然而任何单一的存储器件如传统的机械磁盘（HDD）、固态硬盘（SSD）、非易失型性随机存储器等由于其固有的物理特性的限制，并不能满足以上的需求。将不同的存储介质混合组合成高效的存储系统是一个好的解决方法，固态硬盘作为一种高可靠性、低能耗、高性能的存储器被越来越广泛地运用到混合存储系统。通过将固态硬盘与传统磁盘进行组合，利用固态硬盘的高性能和传统磁盘低成本大容量的特点，能够为用户提供大容量的存储空间，保证系统的高性能，同时还能降低成本。通过阐述SSD与HDD混合存储系统的研究现状，对不同的SSD与HDD混合存储系统进行分类总结；然后针对缓存架构和设备同层架构这两种目前最流行的存储架构中涉及到的关键技术和不足进行讨论；最后对基于SSD和HDD的混合存储技术进行概括总结，并对今后该领域的研究重点和方向进行展望。

关键词: 固态硬盘, 混合存储, 磁盘, 缓存

Abstract: The explosion of data in big data environment brings great challenges to the system structure and capacity of storage system. Nowadays, the development of storage systems tends to be large capacity, low-cost, and high performance. Meanwhile, storage devices such as conventional rotated magnetic Hard Disk Drive (HDD), Solid State Drive (SSD) and Non-Volatile Random Access Memory (NVRAM) have limitations caused by their intrinsic characteristics, leading to the fact that a single kind of storage device cannot meet the requirements above. Hybrid storage which utilized different storage medium was a good solution to this problem. SSD, as a kind of memory wiht high reliability, low energy consumption, high performance is more and more widely applied to hybrid storage system. By combining magnetic disk with the solid-state drives, the advantages of the high performance of SSD and the low-cost, high-capacity features of HDD were taken. The hybrid storage could provide users with large capacity of storage space, guarantee the system's high performance, at the same time reduced the cost. The current research status of the SSD-HDD hybrid storage system was described, different SSD-HDD hybrid storage systems were summarized and classified. In view of two different HDD-SSD hybrid storage architectures, the key technologies and insufficiencies of which were discussed. Prediction of trend and the research focus in the hybrid storage future were discussed at last.

Key words: Solid State Drive (SSD), hybrid storage, magnetic disk, cache

中图分类号:

TP301

陈震, 刘文洁, 张晓, 卜海龙. 基于磁盘和固态硬盘的混合存储系统研究综述[J]. 计算机应用, 2017, 37(5): 1217-1222.

CHEN Zhen, LIU Wenjie, ZHANG Xiao, BO Hailong. Review on HDD-SSD hybrid storage[J]. Journal of Computer Applications, 2017, 37(5): 1217-1222.

参考文献

[1] 祝青, 李小勇. 混合存储综述[J]. 微型电脑应用, 2013, 29(2):33-38.(ZHU Q,LI X Y.A review on hybrid storage[J]. Microcomputer Applications, 2013, 29(2):33-38.)
[2] MEGIDDO N, MODHA D S. ARC:a self-tuning, low overhead replacement cache[C]//Proceedings of the 2nd USENIX Conference on File and Storage Technologies. Berkeley, CA:USENIX Association, 2003:115-130.
[3] WU X, REDDY A L N. Exploiting concurrency to improve latency and throughput in a hybrid storage system[C]//Proceedings of the 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. Piscataway, NJ:IEEE, 2010:14-23.
[4] GUPTA A, KIM Y, URGAONKAR B. DFTL:a flash translation layer employing demand-based selective caching of page-level address mappings[J]. ACM Sigplan Notices, 2009, 44(3):229-240.
[5] LEVY R S. Hybrid storage system:U.S. Patent 8315995[P]. 2012-11-20.
[6] DIRIK C, JACOB B. The performance of PC Solid-State Disks (SSDs) as a function of bandwidth, concurrency, device architecture, and system organization[J]. ACM SIGARCH Computer Architecture News, 2009, 37(3):279-289.
[7] AGRAWAL N, PRABHAKARAN V, WOBBER T, et al. Design tradeoffs for SSD performance[C]//Proceedings of the 2008 USENIX Annual Technical Conference. Berkeley, CA:USENIX Association, 2008:57-70.
[8] JIANG S, CHEN F, ZHANG X. CLOCK-Pro:an effective improvement of the CLOCK replacement[C]//Proceedings of the 2005 Annual Conference on USENIX Annual Technical Conference. Berkeley, CA:USENIX Association, 2005:323-336.
[9] GURUMURTHI S, SIVASUBRAMANIAM A, NATARAJAN V K. Disk drive roadmap from the thermal perspective:a case for dynamic thermal management[J]. ACM SIGARCH Computer Architecture News, 2005, 33(2):38-49.
[10] LIN L, ZHU Y, YUE J, et al. Hot random off-loading:a hybrid storage system with dynamic data migration[C]//Proceedings of the 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems. Piscataway, NJ:IEEE, 2011:318-325.
[11] LALIBERTE B. Automate and optimize a tiered storage environment-FAST![EB/OL].[2016-10-20]. https://wenku.baidu.com/view/1a4d651902768e9951e738af.html.
[12] KGIL T, MUDGE T. FlashCache:a NAND flash memory file cache for low power Web servers[C]//Proceedings of the 2006 International Conference on Compilers, Architecture and Synthesis for Embedded Systems. New York:ACM, 2006:103-112.
[13] UCHIGAITO H, MIURA S, NITO T. A control scheme for eliminating garbage collection during highspeed analysis of big-graph data stored in NAND flash memory[C]//Proceedings of the 2015 IEEE International Symposium on Circuits and Systems. Piscataway, NJ:IEEE, 2015:2557-2560.
[14] LIU R S, CHUANG M Y, YANG C L, et al. Improving read performance of NAND flash SSDs by exploiting error locality[J]. IEEE Transactions on Computers, 2016, 65(4):1090-1102.
[15] SUTARDJA S. Method and apparatus for accessing data stored in a storage system that includes both a final level of cache and a main memory:U.S. Patent 9323688[P]. 2016-04-26.
[16] KGIL T, ROBERTS D, MUDGE T. Improving NAND flash based disk caches[C]//Proceedings of the 35th International Symposium on Computer Architecture. Piscataway, NJ:IEEE, 2008:327-338.
[17] TAI J, LIU D, YANG Z, et al. Improving flash resource utilization at minimal management cost in virtualized flash-based storage systems[EB/OL].[2016-10-20].http://doi.ieeecomputersociety.org/10.1109/TCC.2015.2424886.
[18] HUANG S, WEI Q, FENG D, et al. Improving flash-based disk cache with lazy adaptive replacement[C]//Proceedings of the 2013 IEEE 29th Symposium on Mass Storage Systems and Technologies. Piscataway, NJ:IEEE, 2016:1-10.
[19] ATHANASSOULIS M, CHEN S, AILAMAKI A, et al. Online updates on data warehouses via judicious use of solid-state storage[J]. ACM Transactions on Database Systems, 2015, 40(1):Article No. 6.
[20] SADOGHI M, ROSS K A, CANIM M, et al. Exploiting SSDs in operational multiversion databases[J]. The VLDB Journal, 2015,25(5):651-672.
[21] CANIM M, MIHAILA G A, BHATTACHARJEE B, et al. SSD bufferpool extensions for database systems[J]. Proceedings of the VLDB Endowment, 2010, 3(1/2):1435-1446.
[22] DO J, ZHANG D, PATEL J M, et al. Turbocharging DBMS buffer pool using SSDs[C]//Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data. New York:ACM, 2011:1113-1124.
[23] KANG W H, LEE S W, MOON B. Flash-based extended cache for higher throughput and faster recovery[J]. Proceedings of the VLDB Endowment, 2012, 5(11):1615-1626.
[24] KOLTSIDAS I, VIGLAS S D. Flashing up the storage layer[J]. Proceedings of the VLDB Endowment, 2008, 1(1):514-525.
[25] CHEN F, HOU B, LEE R.Internal parallelism of flash memory-based solid-state drives[J]. ACM Transactions on Storage, 2016, 12(3):1-39.
[26] KANZA Y, YAARI H. External sorting on flash storage:reducing cell wearing and increasing efficiency by avoiding intermediate writes[J]. The VLDB Journal, 2016, 25(4):495-518.
[27] 杨濮源, 金培权, 岳丽华. 一种时间敏感的SSD和HDD高效混合存储模型[J]. 计算机学报, 2012, 35(11):2294-2305.(YANG P Y,JIN P Q,YUE L H. A time-sensitive and efficient hybrid storage model involving SSD and HDD[J]. Chinese Journal of Computers, 2012, 35(11):2294-2305.)
[28] PAYER H, SANVIDO M A, BANDIC Z Z, et al. Combo drive:optimizing cost and performance in a heterogeneous storage device[EB/OL].[2016-10-20].http://www.cs.uni-salzburg.at/~ck/content/publications/conferences/WISH09-ComboDrive.pdf.
[29] CHEONG S K, JEONG J J, JEONG Y W, et al. Research on the I/O performance advancement of a low speed HDD using DDR-SSD[C]//Proceedings of the 6th International Conference Future Information Technology. Berlin:Springer, 2011:508-513.
[30] FISHER N, HE Z, MCCARTHY M. A hybrid filesystem for hard disk drives in tandem with flash memory[J]. Computing, 2012, 94(1):21-68.
[31] LEE S W, MOON B, PARK C, et al. A case for flash memory SSD in enterprise database applications[C]//Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. New York:ACM, 2008:1075-1086.
[32] SOUNDARARAJAN G, PRABHAKARAN V, BALAKRISHNAN M, et al. Extending SSD lifetimes with disk-based write caches[C]//Proceedings of the 8th USENIX Conference on File and Storage Technologies. Berkeley, CA:USENIX Association, 2010:101-114.
[33] YANG P, JIN P, YUE L. Hybrid storage with disk based write cache[C]//Proceedings of the 2011 International Conference on Database Systems for Advanced Applications. Berlin:Springer, 2011:264-275.
[34] MAO B, JIANG H, WU S, et al. HPDA:A hybrid parity-based disk array for enhanced performance and reliability[J]. ACM Transactions on Storage, 2012, 8(1):1-12.
[35] HE J, JAGATHEESAN A, GUPTA S, et al. DASH:a recipe for a flash-based data intensive supercomputer[C]//Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis. Washington, DC:IEEE Computer Society, 2010:1-11.
[36] 沈志荣, 薛巍,舒继武.新型非易失存储研究[J]. 计算机研究与发展, 2014, 51(2):445-453.(SHEN Z R, XUE W, SHU J W. Research on new non-volatile storage[J]. Journal of Computer Research and Development, 2014, 51(2):445-453.)
[37] 张鸿斌,范捷,舒继武,等. 基于相变存储器的存储系统与技术综述[J]. 计算机研究与发展, 2014, 51(8):1647-1662.(ZHANG H B, FAN J, SHU J W, et al. Summary of storage system and technology based on phase change memory[J]. Journal of Computer Research and Development, 2014, 51(8):1647-1662.)

基于磁盘和固态硬盘的混合存储系统研究综述

Review on HDD-SSD hybrid storage

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	施安妮, 李陶深, 王哲, 何璐. 基于缓存辅助的全双工无线携能通信系统的中继选择策略[J]. 计算机应用, 2021, 41(6): 1539-1545.
[2]	汤晨, 黄国锐, 金培权. 非易失性内存友好的线性哈希索引——NVM-LH[J]. 计算机应用, 2021, 41(3): 623-629.
[3]	董豪宇, 陈康. 纯用户态的网络文件系统——RUFS[J]. 计算机应用, 2020, 40(9): 2577-2585.
[4]	柳兴, 杨震, 王新军, 朱恒. 移动边缘计算中的内容分发加速策略[J]. 计算机应用, 2020, 40(5): 1389-1391.
[5]	骆克云, 叶保留, 唐斌, 梅峰, 卢文达. 基于增量学习的RocksDB键值系统主动缓存机制[J]. 计算机应用, 2020, 40(2): 321-327.
[6]	龙彦汕, 富勤学, 郭继斌, 张孟其, 蔡跃明. D2D缓存网络中基于随机几何的成功卸载概率分析[J]. 计算机应用, 2019, 39(8): 2346-2353.
[7]	张超, 李可, 范平志. 基于协作小小区与流行度预测的在线热点视频缓存更新策略[J]. 计算机应用, 2019, 39(7): 2044-2050.
[8]	文凯, 谭笑. 基于用户偏好与副本阈值的端到端缓存算法[J]. 计算机应用, 2019, 39(7): 2051-2055.
[9]	涂大喜, 蒋宇浩, 徐成, 余林琛. 动态自适应的HTTP流码率渐进切换算法[J]. 计算机应用, 2019, 39(4): 1127-1132.
[10]	谭静, 董程凤, 王慧强, 王贺哲, 冯光升, 吕宏武, 袁泉, 陈诗军. ERC²:具有拥塞控制策略的DTN传染路由方法[J]. 计算机应用, 2019, 39(1): 26-32.
[11]	李树, 于炯, 国冰磊, 蒲勇霖, 杨德先, 刘粟. 基于SSD数据库负载的SQL能耗感知模型[J]. 计算机应用, 2019, 39(1): 205-212.
[12]	张震, 付印金, 胡谷雨. 基于布隆过滤器的新型混合内存架构磨损均衡策略[J]. 计算机应用, 2018, 38(8): 2230-2235.
[13]	陈博, 何连跃, 严巍巍, 徐照淼, 徐俊. 海量小文件系统的可移植操作系统接口兼容技术[J]. 计算机应用, 2018, 38(5): 1389-1392.
[14]	张佳辰, 刘晓光, 王刚. 多种存储环境下压缩数据库的缓存优化[J]. 计算机应用, 2018, 38(5): 1404-1409.
[15]	龙彦汕, 吴丹, 蔡跃明, 王萌, 郭继斌. 多缓存容量场景下的D2D内容缓存布设优化方案[J]. 计算机应用, 2018, 38(5): 1453-1457.