关键词: 大文件存储, RAMCloud, 分布式存储系统, 访问延迟

Abstract: Abstract: The RAMCloud is a new kind of distributed key-value storage system that keeps data entirely in DRAM. It aggregates the available memories of thousands of servers by a high-speed network. RAMCloud is a storage system that provides low-latency access to large-scale datasets of small object, but it’s not suitable for large files (tens of MBs or above). In this paper, we proposed a solution to solve this problem based on file splitting and file block merging. We designed and implemented a big file management module, then integrate it into RAMCloud. Experimental result shows that the improved system can support the storage large file efficiently and has a higher read and write performance compared with HDFS. In subsequent work, the system will be integrated into HDFS as a distributed cache management system, so as to improve the performance of HDFS.

Key words: large file storage, RAMCloud, distributed storage system, access latency