Popularity-based full replica caching for erasure-coded distributed storage systems

被引:0
作者
Guillaume Ruty
Hana Baccouch
Victor Nguyen
André Surcouf
Jean-Louis Rougier
Nadia Boukhatem
机构
[1] Cisco Systems PIRL,LTCI
[2] Télécom Paris,undefined
来源
Cluster Computing | 2021年 / 24卷
关键词
Distributed storage systems; Object storage; Erasure codes; Caching;
D O I
暂无
中图分类号
学科分类号
摘要
In most storage systems, the storage nodes store data on a local filesystem. Thus, unless they have a dedicated caching layer, they benefit from the usual filesystem cache in the host’s free memory. However, in erasure-coded storage systems, caching is effective only if all the systematic fragments corresponding to an object are in the cache. In this work, we propose a new caching policy adapting traditional methods to erasure-coded storage systems. The main idea of our solution is to cache a full object rather than fragments object. A simulation-based evaluation showed that our full replica solution is able to improve the cache hit ratio and reduce the cache waste ratio compared to the traditional caching method. Moreover, experimental evaluation has been conducted. It indicates that our implementation not only validates the previous results but also shows that cache hits on full replicas have a better request response time.
引用
收藏
页码:3173 / 3186
页数:13
相关论文
共 62 条
[1]  
Lakshman A(2010)Cassandra: a decentralized structured storage system SIGOPS Oper. Syst. Rev. 44 35-40
[2]  
Malik P(2003)The Google file system SIGOPS Oper. Syst. Rev. 37 29-43
[3]  
Ghemawat S(2008)BigTable: a distributed storage system for structured data ACM Trans. Comput. Syst. 26 4:1-4:26
[4]  
Gobioff H(2020)Effective cache replacement strategy (ECRS) for real-time fog computing environment Clust. Comput. 23 1-25
[5]  
Leung S-T(2020)Energy and delay efficient fog computing using caching mechanism Comput. Commun. 154 534-541
[6]  
Chang F(2019)FCR-NS: a novel caching and forwarding strategy for named data networking based on software defined networking Clust. Comput. 22 981-994
[7]  
Dean J(2019)Bloom-filter-based request node collaboration caching for named data networking Clust. Comput. 22 6681-6692
[8]  
Ghemawat S(2017)An efficient distributed caching for accessing small files in HDFS Clust. Comput. 20 3579-3592
[9]  
Hsieh WC(2019)Achieving load-balanced, redundancy-free cluster caching with selective partition IEEE Trans. Parallel Distrib. Syst. 31 439-454
[10]  
Wallach DA(2016)Joint latency and cost optimization for erasure-coded data center storage IEEE/ACM Trans. Netw. 24 2443-2457