Understanding Data Characteristics and Access Patterns in a Cloud Storage System

被引：25
作者：
Liu, Songbin [1 ]
Huang, Xiaomeng [1 ]
Fu, Haohuan [1 ]
Yang, Guangwen [1 ]
机构：
[1] Tsinghua Univ, Minist Educ, Key Lab Earth Syst Modeling, Beijing 100084, Peoples R China
来源：
PROCEEDINGS OF THE 2013 13TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID 2013) | 2013年
关键词：
Cloud Storage; File System; Data Characteristic; Access Pattern;
D O I：
10.1109/CCGrid.2013.11
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Understanding the inherent system characteristics is crucial to the design and optimization of cloud storage system, and few studies have systematically investigated its data characteristics and access patterns. This paper presents an analysis of file system snapshot and five-month access trace of a campus cloud storage system that has been deployed on Tsinghua campus for three years. The system provides online storage and data sharing services for more than 19,000 students and 500 student groups. We report several data characteristics including file size and file type, as well as some access patterns, including read/write ratio, read-write dependency and daily traffic. We find that there are many differences between cloud storage system and traditional file systems: our cloud storage system has larger file sizes, lower read/ write ratio, and smaller set of active files than those of a typical traditional file system. With a trace-driven simulation, we find that the cache efficiency can be improved by 5 times using the guidance from our observations.
引用
收藏
页码：327 / 334
页数：8
相关论文
共 23 条
  • [1] Aamnitchi A., 2006, Proceedings of the 15th IEEE International Symposium on High Performance Distributed Computing (IEEE Cat. No.06TH8878), P69
  • [2] Agrawal Nitin, 2007, ACM Transactions on Storage, V3, DOI 10.1145/1288783.1288788
  • [3] Ali N, 2009, 2009 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING AND WORKSHOPS, P86
  • [4] [Anonymous], 2008, P USENIX ANN TECHN C
  • [5] Baker M. G., 1991, Operating Systems Review, V25, P198, DOI 10.1145/121133.121164
  • [6] Dayal S., 2008, CMUPDL08109
  • [7] Douceur JR, 1999, PERFORMANCE EVALUATION REVIEW, SPECIAL ISSUE, VOL 27 NO 1, JUNE 1999, P59, DOI 10.1145/301464.301480
  • [8] Drago I., 2012, P INT MEAS C BOST MA
  • [9] Ellard D., 2003, FAST 03
  • [10] Evans K. M., 2002, SPECTS
123