计算机应用 ›› 2017, Vol. 37 ›› Issue (5): 1241-1245.DOI: 10.11772/j.issn.1001-9081.2017.05.1241

• 第22届全国信息存储技术学术会议 • 上一篇    下一篇

Pmfs中目录项索引的实现

杨顺, 陈志广, 肖侬   

  1. 国防科学技术大学 计算机学院, 长沙 410073
  • 收稿日期:2016-07-15 修回日期:2016-12-07 出版日期:2017-05-10 发布日期:2017-05-16
  • 通讯作者: 杨顺
  • 作者简介:杨顺(1992-),男,湖北荆州人,硕士研究生,主要研究方向:非易失存储器、文件系统;陈志广(1984-),男,湖北襄阳人,助理研究员,博士,CCF会员,主要研究方向:高性能存储、高性能计算;肖侬(1969-),男,江西南昌人,研究员,博士生导师,博士,CCF会员,主要研究方向:高性能计算、大规模网络存储。
  • 基金资助:
    国家863计划项目(2015AA015305)。

Implementation of directory index for Pmfs

YANG Shun, CHEN Zhiguang, XIAO Nong   

  1. College of Computer, National University of Defense Technology, Changsha Hunan 410073, China
  • Received:2016-07-15 Revised:2016-12-07 Online:2017-05-10 Published:2017-05-16
  • Supported by:
    This work is partially supported by the National High Technology Research and Development Program (863 Program) of China (2015AA015305).

摘要: 可字节寻址的非易失存储介质,如相变存储器等,使数据可以在内存级别持久化。由于非易失存储器(NVM)本身的读写延时非常低,系统软件开销成为了决定整个持久化内存系统性能的主要因素。Pmfs是一个专门为持久化内存所设计的文件系统,然而,Pmfs下的每个目录操作(打开、创建或删除)都会遍历目录下的所有目录项,导致了随文件数增长而线性增长的目录项查找开销。通过测试发现,在特定类型负载下这种开销成为了整个文件系统的瓶颈。针对该问题,在Pmfs中实现了持久化的目录项索引来加速目录操作。测试结果显示,基于单目录下100000文件的负载,该优化使得文件创建速度提高了12倍,带宽增加了27.3%。

关键词: 持久化内存, 目录项索引, 文件系统, 非易失存储器

Abstract: Emerging non-volatile, byte-addressable memories like phase-change memory can make data persistent at main memory level instead of storage. Since the read/write latency of Non-Volatile Memory (NVM) is very low, the overhead of software in a NVM system has become the main factor in determining the performance of the entire persistent memory system. Pmfs is a file system specifically designed for NVM. However, it still has an undesirable characteristic:each directory operation (create, open or delete) of Pmfs requires a linear search of the entire directory files, resulting in a cost linearly increased with the number of files in the directory. The performance of Pmfs under various workloads was evaluated and the test showed that the overhead of the directory operations had become the bottleneck of the whole system in some circumstance of particular workloads. To solve this problem, a persistent directory entry index was implemented in Pmfs to speed up directory operations. The experimental results show that under a single directory with 100 000 files, the file creation speed is increased by 12 times, the bandwidth is improved by 27.3%.

Key words: persistent memory, directory index, file system, Non-Volatile Memory (NVM)

中图分类号: