《计算机应用》唯一官方网站 ›› 2020, Vol. 40 ›› Issue (2): 541-546.DOI: 10.11772/j.issn.1001-9081.2019091655

• 第七届CCF大数据学术会议 • 上一篇    下一篇

面向NVM存储系统的快速文件访问系统

贺庆建1, 蔡涛2(), 王杰2, 牛德姣2   

  1. 1.江苏大学 京江学院,江苏 镇江 212013
    2.江苏大学 计算机科学与通信工程学院,江苏 镇江 212013
  • 收稿日期:2019-08-30 修回日期:2019-10-17 接受日期:2019-10-18 发布日期:2019-11-04 出版日期:2020-02-10
  • 通讯作者: 蔡涛
  • 作者简介:贺庆建(1991—),男,江苏淮安人,硕士,主要研究方向:新型存储系统
    王杰(1994—),男,江苏扬州人,硕士研究生,CCF会员,主要研究方向:新型存储系统
    牛德姣(1978—),女,河南叶县人,副教授,博士,CCF会员,主要研究方向:新型存储系统、神经网络。
  • 基金资助:
    国家自然科学基金资助项目(61806086);国家重点研发计划项目(2018YFB0804204);中国博士后基金资助项目(2016M601737)

Fast file access system for NVM storage systems

Qingjian HE1, Tao CAI2(), Jie WANG2, Dejiao NIU2   

  1. 1.Jingjiang College,Jiangsu University,Zhenjiang Jiangsu 212013,China
    2.College of Computer Science and Communication,Jiangsu University,Zhenjiang Jiangsu 212013,China
  • Received:2019-08-30 Revised:2019-10-17 Accepted:2019-10-18 Online:2019-11-04 Published:2020-02-10
  • Contact: Tao CAI
  • About author:HE Qingjian, born in 1991, M. S. His research interests include new storage system.
    WANG Jie, born in 1994, M. S. candidate. His research interests include new storage system.
    NIU Dejiao, born in 1978, Ph. D., associate professor. Her research interests include new storage system, neural network.
  • Supported by:
    the National Natural Science Foundation of China(61806086);the National Key Research and Development Program of China(2018YFB0804204);the China Postdoctoral Science Foundation(2016M601737)

摘要:

NVM存储设备系统具备提供高吞吐的潜质,包括接近内存的读写速度、字节寻址特性和支持多路转发等优势。但现有的系统软件栈并没有针对NVM去设计,使得系统软件栈存在许多影响系统访问性能的因素。通过分析发现文件系统的锁机制具有较大的开销,这使得数据的并发访问在多核心环境下成为一个难题。为了缓解这些问题,设计了无锁的文件读写机制以及基于字节的读写接口。通过取消基于文件的锁机制改变了粗粒度的访问控制,利用自主管理请求提高了进程的并发度;在设计能够利用字节寻址的新的文件访问接口时,不仅考虑了NVM存储设备的读写非对称,还考虑了其读写操作的不同特性。这些设计减少了软件栈的开销,有利于发挥NVM特性来提供一个高并发、高吞吐和耐久的存储系统。最后利用开源NVM模拟器PMEM实现了FPMRW原型系统,使用Filebench通用测试工具对FPMRW进行测试与分析,结果显示,FPMRW相对EXT+PMEM和XFS+PMEM能提高3%~40%的系统吞吐率。

关键词: NVM存储系统, 文件锁, 字节寻址, 文件系统, 读写非对称

Abstract:

NVM (Non-Volatile Memory) storage system has the potential to provide high throughput, including near-memory read and write speeds, byte addressing features, and support for multi-way forwarding. However, the existing system software stack is not designed for NVM, which makes the system software stack have many factors that affect system access performance. Through analysis, it is found that the lock mechanism of the file system has a large overhead, which makes the concurrent access of data to be a difficult problem under multi-core environment. In order to alleviate these problems, a lock-free file reading and writing mechanism as well as a byte-based read and write interface were designed. By eliminating the file-based lock mechanism, the coarse-grained access control was changed, and the self-management request was used to improve the concurrency of the process. When designing the new file access interface that can utilize byte addressing, the read-write asymmetry as well as the different characteristics of the read and write operations of the NVM storage device were considered. These designs reduce the overhead of the software stack and make the full use of NVM features to provide a high concurrent, high throughput, and durable storage system. Finally, based on the open source NVM simulator PMEM, the FPMRW prototype system was implemented, and the universal test tool Filebench was used to test and analyze the FPRRW. The results show that the FPMRW can improve the system throughput by 3%-40% compared with EXT+PMEM and XFS+PMEM.

Key words: NVM (Non-Volatile Memory) storage system, file lock, byte addressing, file system, read-write asymmetry

中图分类号: