A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
来源
2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021) | 2021年
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [21] An Adaptive Erasure Code for JointCloud Storage of Internet of Things Big Data
    Bao, Han
    Wang, Yijie
    Xu, Fangliang
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (03): : 1613 - 1624
  • [22] A Novel Completely Local Repairable Code Algorithm Based on Erasure Code
    Fang, Ying
    Tan, Hai
    Wang, Shuaifang
    Zhang, Xin
    Liao, Gejian
    Zhang, Jun
    TEHNICKI VJESNIK-TECHNICAL GAZETTE, 2022, 29 (05): : 1658 - 1664
  • [23] Cost-Effective Data Placement in Edge Storage Systems With Erasure Code
    Jin, Hai
    Luo, Ruikun
    He, Qiang
    Wu, Song
    Zeng, Zilai
    Xia, Xiaoyu
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (02) : 1039 - 1050
  • [24] QoS-Aware Distributed Cloud Storage Service based on Erasure Code in Multi-Cloud Environment
    Su, Wei-Tsung
    Dai, Cheng-Yi
    2017 14TH IEEE ANNUAL CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE (CCNC), 2017, : 365 - 368
  • [25] SDNC-Repair: A Cooperative Data Repair Strategy Based on Erasure Code for Software-Defined Storage
    Chen, Ningjiang
    Liu, Weitao
    Pu, Wenjuan
    Liu, Yifei
    Zhong, Qingwei
    SENSORS, 2023, 23 (13)
  • [26] Priority differentiated multicast flow scheduling method in Ceph cloud storage network
    Ke W.
    Wang Y.
    Ye M.
    Chen J.
    Tongxin Xuebao/Journal on Communications, 2020, 41 (11): : 40 - 51
  • [27] A New Robust and Reversible Watermarking Technique Based on Erasure Code
    Chai, Heyan
    Yang, Shuqiang
    Jiang, Zoe L.
    Wang, Xuan
    Chen, Yiqun
    Luo, Hengyu
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING (ICA3PP 2019), PT I, 2020, 11944 : 153 - 168
  • [28] An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm
    Wang, Zizhong
    Wang, Haixia
    Shao, Airan
    Wang, Dongsheng
    PROCEEDINGS OF THE 49TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, ICPP 2020, 2020,
  • [29] An Adaptive Erasure-Coded Storage Scheme with an Efficient Code-Switching Algorithm
    Wang, Zizhong
    Wang, Haixia
    Shao, Airan
    Wang, Dongsheng
    2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, : 1177 - 1178
  • [30] A method of repairing single node failure in the distributed storage system based on the regenerating-code and a hybrid genetic algorithm
    Ye, Miao
    Qiu, Hongbing
    Wang, Yong
    Zhou, Zou
    Zheng, Fei
    Ma, Tianxin
    NEUROCOMPUTING, 2021, 458 : 566 - 578