A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
来源
2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021) | 2021年
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 8 条
[1]   Sprout: A Functional Caching Approach to Minimize Service Latency in Erasure-Coded Storage [J].
Aggarwal, Vaneet ;
Chen, Yih-Farn Robin ;
Lan, Tian ;
Xiang, Yu .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2017, 25 (06) :3683-3694
[2]  
Chen L., 2020, 2020 INT C COMP VIS, P206
[3]  
Lin Roscoe, 2017, 2017 IEEE 4th International Conference on Cyber-Security and Cloud Computing (CSCloud), P10, DOI 10.1109/CSCloud.2017.40
[4]   ProactiveCache: On Reducing Degraded Read Latency of Erasure Coded Cloud Storage [J].
Nachiappan, Rekha ;
Javadi, Bahman ;
Calheiros, Rodrigo N. ;
Matawie, Kenan .
11TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING TECHNOLOGY AND SCIENCE (CLOUDCOM 2019), 2019, :223-230
[5]   Feasibility Study of Location-Conscious Multi-Site Erasure-Coded Ceph Storage for Disaster Recovery [J].
Uehara, Keitaro ;
Chen, Yih-Farn Robin ;
Hiltunen, Matti ;
Joshi, Kaustubh ;
Schlichting, Richard .
2018 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2018), 2018, :204-210
[6]  
Weil SA, 2006, USENIX ASSOCIATION 7TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P307
[7]  
Zhang JY, 2017, IEEE INT CONF BIG DA, P2676, DOI 10.1109/BigData.2017.8258230
[8]  
Zheng Qing, 2013, P 4 ACM SPEC INT C P, P199