CarrierFS: a virtual memory based distributed file system

被引：0

作者：

Xu, Chuncong ^{[1
,2
]}

Huang, Xiaomeng ^{[1
,2
]}

Xu, Pengzhi ^{[1
,2
]}

Wu, Nuo ^{[1
,2
]}

Liu, Songbin ^{[1
,2
]}

Yang, Guangwen ^{[1
,2
]}

机构：

[1] Tsinghua National Laboratory for Information Science and Technology, Tsinghua University, Beijing 100084, China

[2] Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

来源：

Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition) | 2010年 / 38卷 / SUPPL. 1期

关键词：

Access latency - Distributed file systems - Small files - Storage systems - Virtual memory;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Existing disk-based distributed file systems suffer from performance degradation on small files, as a result of the I/O bottleneck of disk. This paper demonstrates that significant performance gains can be achieved if, instead, all the data can be stored in memory. We explore the design and implementation of such a memory-based distributed file system, called CarrierFS, which also ensures the reliability of system by introducing supervisor modules and offers reliable storage by using disk for backup. Experimental results show that CarrierFS provides a high performance solution both on small and large files. Compared to HDFS(Hadoop Distributed File System), it increases both read and write performance on small files by a factor of 3.0~3.4, and on large files by a factor of 1.30~1.95.

引用

页码：37 / 42