Fast file access system for NVM storage systems

doi:10.11772/j.issn.1001-9081.2019091655

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (2): 541-546.DOI: 10.11772/j.issn.1001-9081.2019091655

• CCF Bigdata 2019 • Previous Articles Next Articles

Fast file access system for NVM storage systems

Qingjian HE¹, Tao CAI²(), Jie WANG², Dejiao NIU²

^1.Jingjiang College，Jiangsu University，Zhenjiang Jiangsu 212013，China
^2.College of Computer Science and Communication，Jiangsu University，Zhenjiang Jiangsu 212013，China

Received:2019-08-30 Revised:2019-10-17 Accepted:2019-10-18 Online:2019-11-04 Published:2020-02-10
Contact: Tao CAI
About author:HE Qingjian， born in 1991， M. S. His research interests include new storage system.
WANG Jie， born in 1994， M. S. candidate. His research interests include new storage system.
NIU Dejiao， born in 1978， Ph. D.， associate professor. Her research interests include new storage system， neural network.
Supported by:
the National Natural Science Foundation of China(61806086);the National Key Research and Development Program of China(2018YFB0804204);the China Postdoctoral Science Foundation(2016M601737)

面向NVM存储系统的快速文件访问系统

贺庆建¹, 蔡涛²(), 王杰², 牛德姣²

^1.江苏大学京江学院，江苏镇江 212013
^2.江苏大学计算机科学与通信工程学院，江苏镇江 212013

通讯作者: 蔡涛
作者简介:贺庆建（1991—），男，江苏淮安人，硕士，主要研究方向：新型存储系统
王杰（1994—），男，江苏扬州人，硕士研究生，CCF会员，主要研究方向：新型存储系统
牛德姣（1978—），女，河南叶县人，副教授，博士，CCF会员，主要研究方向：新型存储系统、神经网络。
基金资助:
国家自然科学基金资助项目(61806086);国家重点研发计划项目(2018YFB0804204);中国博士后基金资助项目(2016M601737)

Abstract

Abstract:

NVM （Non-Volatile Memory） storage system has the potential to provide high throughput， including near-memory read and write speeds， byte addressing features， and support for multi-way forwarding. However， the existing system software stack is not designed for NVM， which makes the system software stack have many factors that affect system access performance. Through analysis， it is found that the lock mechanism of the file system has a large overhead， which makes the concurrent access of data to be a difficult problem under multi-core environment. In order to alleviate these problems， a lock-free file reading and writing mechanism as well as a byte-based read and write interface were designed. By eliminating the file-based lock mechanism， the coarse-grained access control was changed， and the self-management request was used to improve the concurrency of the process. When designing the new file access interface that can utilize byte addressing， the read-write asymmetry as well as the different characteristics of the read and write operations of the NVM storage device were considered. These designs reduce the overhead of the software stack and make the full use of NVM features to provide a high concurrent， high throughput， and durable storage system. Finally， based on the open source NVM simulator PMEM， the FPMRW prototype system was implemented， and the universal test tool Filebench was used to test and analyze the FPRRW. The results show that the FPMRW can improve the system throughput by 3%-40% compared with EXT+PMEM and XFS+PMEM.

Key words: NVM (Non-Volatile Memory) storage system, file lock, byte addressing, file system, read-write asymmetry

摘要：

NVM存储设备系统具备提供高吞吐的潜质，包括接近内存的读写速度、字节寻址特性和支持多路转发等优势。但现有的系统软件栈并没有针对NVM去设计，使得系统软件栈存在许多影响系统访问性能的因素。通过分析发现文件系统的锁机制具有较大的开销，这使得数据的并发访问在多核心环境下成为一个难题。为了缓解这些问题，设计了无锁的文件读写机制以及基于字节的读写接口。通过取消基于文件的锁机制改变了粗粒度的访问控制，利用自主管理请求提高了进程的并发度；在设计能够利用字节寻址的新的文件访问接口时，不仅考虑了NVM存储设备的读写非对称，还考虑了其读写操作的不同特性。这些设计减少了软件栈的开销，有利于发挥NVM特性来提供一个高并发、高吞吐和耐久的存储系统。最后利用开源NVM模拟器PMEM实现了FPMRW原型系统，使用Filebench通用测试工具对FPMRW进行测试与分析，结果显示，FPMRW相对EXT+PMEM和XFS+PMEM能提高3%~40%的系统吞吐率。

关键词: NVM存储系统, 文件锁, 字节寻址, 文件系统, 读写非对称

CLC Number:

TP39

Qingjian HE, Tao CAI, Jie WANG, Dejiao NIU. Fast file access system for NVM storage systems[J]. Journal of Computer Applications, 2020, 40(2): 541-546.

贺庆建, 蔡涛, 王杰, 牛德姣. 面向NVM存储系统的快速文件访问系统[J]. 《计算机应用》唯一官方网站, 2020, 40(2): 541-546.

Figures/Tables 6

Fig. 1 Structure of FPMRW

Fig. 2 Call stack of write in file system

Tab. 1 Software and hardware configuration of testing environment of prototype system

部件	配置
CPU	2个 Intel Xeon E5-2620
Memory	128 GB
Disk	600 GB SAS Disk， 120 GB SAS SSD
OS	CentOS 7.0， Kernel 4.4.112

Fig. 3 Tesing with Copyfiles workload

Fig. 4 Testing with Webproxy workload

Fig. 5 Testing with Randomrw workload

References 18

1	SWANSON S， CAULFIELD A M. Refactor， reduce， recycle： restructuring the I/O stack for the future of storage［J］. Computer， 2013， 46（8）：52-59. 10.1109/MC.2013.222
2	CAULFIELD A M， MOLLOV T I， EISNER L A， et al. Providing safe， user space access to fast， solid state disks［J］. ACM SIGARCH Computer Architecture News， 2012， 40（1）： 387-400. 10.1145/2189750.2151017
3	EISNER L A， MOLLOV T， SWANSON S. Quill： exploiting fast non-volatile memory by transparently bypassing the file system［R］. La Jolla， CA： University of California， 2013.
4	EISENMAN A， GARDNER D， ABDELRAHMAN I， et al. Reducing DRAM footprint with NVM in Facebook［C］// Proceedings of the 13th EuroSys Conference. New York： ACM， 2018： No.42. 10.1145/3190508.3190524
5	WEI Q， CHEN C， XUE M， et al. Extending SSD lifetime with persistent in-memory metadata management［C］// Proceedings of the 2016 IEEE International Conference on Cluster Computing. Piscataway： IEEE， 2016： 308-311. 10.1109/cluster.2016.45
6	VOLOS H， NALLI S， PANNEERSELVAM S， et al. Aerie： flexible file-system interface to storage-class memory［C］// Proceedings of the 9th European Conference on Computer Systems. New York： ACM， 2014： No.14. 10.1145/2592798.2592810
7	BITTMAN D， GRAY M， RAIZES J， et al. Designing data structures to minimize bit flips on NVM［C］// Proceedings of the IEEE 7th Non-Volatile Memory Systems and Applications Symposium. Piscataway： IEEE， 2018：85-90. 10.1109/nvmsa.2018.00022
8	KOLLI A， PELLEY S， SAIDI A， et al. High-performance transactions for persistent memories［J］. ACM SIGPLAN Notices， 2016， 51（4）：399-411. 10.1145/2954679.2872381
9	金培权，郝行军，岳丽华. 面向新型存储的大数据存储架构与核心算法综述［J］. 计算机工程与科学， 2013， 35（10）：12-24. 10.3969/j.issn.1007-130X.2013.10.002
	JIN P Q， HAO X J， YUE L H. A survey on storage architectures and core algorithms for big data management on new storages［J］. Computer Engineering and Science， 2013， 35（10）：12-24. 10.3969/j.issn.1007-130X.2013.10.002
10	孙广宇，舒继武，王鹏. 面向非易失内存的结构和系统级设计与优化综述［J］. 华东师范大学学报（自然科学版）， 2014（5）： 72-81. 10.3969/j.issn.1000-5641.2014.05.006
	SUN G Y， SHU J W， WANG P. Survey of architecture and system level optimization for non-volatile main memory［J］. Journal of East China Normal University （Natural Science）， 2014（5）： 72-81. 10.3969/j.issn.1000-5641.2014.05.006
11	DULLOOR S R， KUMAR S， KESHAVAMURTHY A， et al. System software for persistent memory［C］// Proceedings of the 9th European Conference on Computer Systems. New York： ACM， 2014：No.15. 10.1145/2592798.2592814
12	XU J， SWANSON S. NOVA： a log-structured file system for hybrid volatile/non-volatile main memories［C］// Proceedings of the 14th USENIX Conference on File and Storage Technologies. Berkeley： USENIX Association， 2016： 323-338. 10.1145/3132747.3132761
13	CAMPELLO D， LOPEZ H， USECHE L， et al. Non-blocking writes to files［C］// Proceedings of the 13th USENIX Conference on File and Storage Technologies. Berkeley： USENIX Association， 2015： 151-165.
14	KANNAN S， ARPACI-DUSSEAU A C， ARPACI-DUSSEAU R H， et al. Designing a true direct-access file system with DevFS［C］// Proceedings of the 16th USENIX Conference on File and Storage Technologies. Berkeley： USENIX Association， 2018： 241-255.
15	KOLLI A， PELLEY S， SAIDI A， et al. High-performance transactions for persistent memories［J］. ACM SIGPLAN Notices， 2016， 51（4）： 399-411. 10.1145/2954679.2872381
16	DONG M， CHEN H. Soft updates made simple and fast on non-volatile memory［C］// Proceedings of the 2017 USENIX Annual Technical Conference. Berkeley： USENIX Association， 2017：719-731.
17	蔡涛，王杰，牛德姣，等.基于冲突检测的高吞吐NVM存储系统［J］.计算机研究与发展，2020，57（2）. 10.7544/issn1000-1239.2020.20190526
	CAI T，WANG J，NIU D J，et al.A high throughput NVM storage system based on access request conflict detection［J］.Journal of Computer Research and Development， 2020， 57（2）. 10.7544/issn1000-1239.2020.20190526
18	蔡涛，陈志鹏，牛德姣，等. 支持高并发访问的新型NVM存储系统［J］. 计算机应用， 2019， 39（1）： 51-56. 10.11772/j.issn.1001-9081.2018071644
	CAI T， CHEN Z P， NIU D J， et al. New NVM storage system that supports high concurrent access［J］. Journal of Computer Applications， 2019， 39（1）： 51-56. 10.11772/j.issn.1001-9081.2018071644

[1]	Xu LI, Yulin HE, Laizhong CUI, Zhexue HUANG, Fournier‑Viger PHILIPPE. Distributed observation point classifier for big data with random sample partition [J]. Journal of Computer Applications, 2024, 44(6): 1727-1733.
[2]	Ruixuan NI, Miao CAI, Baoliu YE. DFS-Cache： memory-efficient and persistent client cache for distributed file systems [J]. Journal of Computer Applications, 2024, 44(4): 1172-1180.
[3]	Meihong CHEN, Lingyun YUAN, Tong XIA. Data classified and graded access control model based on master-slave multi-chain [J]. Journal of Computer Applications, 2024, 44(4): 1148-1157.
[4]	Xiaoyu DU, Shuaiqi LIU, Zhijie HAN, Zhenxiang HUO, Yujing WANG. Patient-centric medical information sharing scheme based on IPFS and blockchain [J]. Journal of Computer Applications, 2024, 44(10): 3122-3133.
[5]	ZHANG Guochao, TANG Huayun, CHEN Jianhai, SHEN Rui, HE Qinming, HUANG Butian. Digital music copyright management system based on blockchain [J]. Journal of Computer Applications, 2021, 41(4): 945-955.
[6]	GOU Zi'an, ZHANG Xiao, WU Dongnan, WANG Yanqiu. Log analysis and workload characteristic extraction in distributed storage system [J]. Journal of Computer Applications, 2020, 40(9): 2586-2593.
[7]	DONG Haoyu, CHEN Kang. RUFS: a pure userspace network file system [J]. Journal of Computer Applications, 2020, 40(9): 2577-2585.
[8]	Fuxin LIU, Jingwei LI, Yihong WANG, Lin LI. Design and implementation of cloud native massive data storage system based on Kubernetes [J]. Journal of Computer Applications, 2020, 40(2): 547-552.
[9]	DONG Cong, ZHANG Xiao, CHENG Wendi, SHI Jia. Performance optimization of distributed file system based on new type storage devices [J]. Journal of Computer Applications, 2020, 40(12): 3594-3603.
[10]	WANG Keke, CHEN Zhide, XU Jian. Efficient traceability system for quality and safety of agricultural products based on consortium blockchain [J]. Journal of Computer Applications, 2019, 39(8): 2438-2443.
[11]	CHEN Bo, HE Lianyue, YAN Weiwei, XU Zhaomiao, XU Jun. Portable operating system interface of UNIX compatibility technology in mass small distributed file system [J]. Journal of Computer Applications, 2018, 38(5): 1389-1392.
[12]	LI Qiang, LIU Xiaofeng. Load balancing strategy of cloud storage based on Hopfield neural network [J]. Journal of Computer Applications, 2017, 37(8): 2214-2217.
[13]	YANG Shun, CHEN Zhiguang, XIAO Nong. Implementation of directory index for Pmfs [J]. Journal of Computer Applications, 2017, 37(5): 1241-1245.
[14]	YANG Junjie, LIAO Zhuofan, FENG Chaochao. Survey on big data storage framework and algorithm [J]. Journal of Computer Applications, 2016, 36(9): 2465-2471.
[15]	WANG Kang, LI Qingbao. File hiding based on capacity disguise and double file system [J]. Journal of Computer Applications, 2016, 36(4): 979-984.

Fast file access system for NVM storage systems

面向NVM存储系统的快速文件访问系统

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 6

References 18

Related Articles 15

Recommended Articles

Metrics