A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
来源
2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021) | 2021年
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [1] Blockchain Storage Optimization Based on Erasure Code
    Fan Y.-Q.
    Sheng D.
    Wang L.-F.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (04): : 858 - 876
  • [2] The Data Redundancy Method for Distributed Storage based on Erasure Code
    Li, Zhi
    Pan, Chao
    MIPPR 2015: REMOTE SENSING IMAGE PROCESSING, GEOGRAPHIC INFORMATION SYSTEMS, AND OTHER APPLICATIONS, 2015, 9815
  • [3] Storage Node Allocation Methods for Erasure Code-based Cloud Storage Systems
    Lee, Ojus Thomas
    Akash, G. J.
    Kumar, S. D. Madhu
    Chandran, Priya
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2019, 44 (11) : 9127 - 9142
  • [4] NADE: nodes performance awareness and accurate distance evaluation for degraded read in heterogeneous distributed erasure code-based storage
    Zhang, Xingjun
    Cai, Yi
    Liu, Yunfei
    Xu, Zhiwei
    Dong, Xiaoshe
    JOURNAL OF SUPERCOMPUTING, 2020, 76 (07) : 4946 - 4975
  • [5] NADE: nodes performance awareness and accurate distance evaluation for degraded read in heterogeneous distributed erasure code-based storage
    Xingjun Zhang
    Yi Cai
    Yunfei Liu
    Zhiwei Xu
    Xiaoshe Dong
    The Journal of Supercomputing, 2020, 76 : 4946 - 4975
  • [6] An Erasure Code Based Wireless Distributed Storage System Implementation
    Wu, Jiajia
    Wang, Li
    Hua, Chu
    Zhao, Wei
    Wang, Ge
    Chuan, Jianbin
    2018 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2018, : 730 - 731
  • [7] Supporting heterogeneous pools in a single Ceph storage cluster
    Meyer, Stefan
    Morrison, John P.
    2015 17TH INTERNATIONAL SYMPOSIUM ON SYMBOLIC AND NUMERIC ALGORITHMS FOR SCIENTIFIC COMPUTING (SYNASC), 2016, : 352 - 359
  • [8] A Reliable Secure Storage Cloud and Data Migration Based on Erasure Code
    Mugisha, Emmy
    Zhang, Gongxuan
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2018, 12 (01): : 436 - 453
  • [9] Load Balancing Technology based on Erasure Code in Distributed Storage System
    Ding Caiwei
    Wang Lei
    Sun Liansheng
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 5558 - 5563
  • [10] CLEC: Combination Locality Based Erasure Code for Permissioned Blockchain Storage
    Wu, Jiabin
    Yang, Boai
    Liu, Yang
    Liu, Fang
    Xiao, Nong
    Li, Shuo
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 73 (03): : 5137 - 5150