A Heterogeneous Hybrid Storage Method Based on Ceph Erasure Code

被引:1
|
作者
Qin, Mingyuan [1 ]
Fu, Zheng [1 ]
机构
[1] Chongqing Univ Posts & Telecommun, Coll Comp Sci & Technol, Chongqing, Peoples R China
来源
2021 ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE (ACCTCS 2021) | 2021年
关键词
Ceph; TOPSIS; heterogeneous hybrid storage; multi-attribute decision-making; Erasure Code; LATENCY;
D O I
10.1109/ACCTCS52002.2021.00044
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to achieve the goal of reducing storage redundancy, Ceph provides support for erasure code technology, which can more effectively use storage space. However, when Ceph selects storage nodes, it only uses storage capacity as the only indicator, without considering the resource load status and the heterogeneous situation of nodes, which makes a large number of read and write tasks allocated to storage nodes with lower performance. The above causes the problem of low reading and writing efficiency in Ceph erasure code mode. Based on this problem, we propose a heterogeneous hybrid storage method based on Ceph erasure code. Under the premise of comprehensively considering node CPU utilization, memory utilization and other performance indicators, Using TOPSIS method to implement multi-attribute decision-making and assigning Ceph erasure code tasks to the storage node with best performance. Experiments show that the method can effectively improve the read and write performance of large objects in Ceph erasure code mode.
引用
收藏
页码:182 / 186
页数:5
相关论文
共 50 条
  • [41] Erasure-Code-Based DTN Multi-Path Routing for Contact Avoidance
    Arai, Hironori
    Arai, Masayuki
    2017 IEEE 22ND PACIFIC RIM INTERNATIONAL SYMPOSIUM ON DEPENDABLE COMPUTING (PRDC 2017), 2017, : 215 - 216
  • [42] Repair Pipelining for Erasure-Coded Storage Based on Load-Balanced
    Jiang X.-Y.
    Li G.-Y.
    Zhou Y.
    Hu J.-P.
    Li H.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (05): : 930 - 936
  • [43] A Fast Construction Method of the Erasure Code with Small Cross-Cloud Data Center Repair Traffic
    Bao H.
    Wang Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (10): : 2418 - 2439
  • [44] Short Tail: taming tail latency for erasure-code-based in-memory systems
    Teng, Yun
    Li, Zhiyue
    Huang, Jing
    Zhang, Guangyan
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2022, 23 (11) : 1646 - 1657
  • [45] ESDU: An elastic stripe-based delta update method for erasure-coded cross-data center storage systems
    Bao, Han
    Wang, Yijie
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2022, 167 : 173 - 186
  • [46] Strip-Switched Deployment Method to Optimize Single Failure Recovery for Erasure Coded Storage Systems
    Fu, Yingxun
    Wen, Shilin
    Ma, Li
    Duan, Jianyong
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (11): : 2818 - 2822
  • [47] GRID codes: Strip-based erasure codes with high fault tolerance for storage systems
    Li, Mingqiang
    Shu, Jiwu
    Zheng, Weimin
    ACM Transactions on Storage, 2009, 4 (04)
  • [48] An Efficient Failure Reconstruction Based on In-Network Computing for Erasure-Coded Storage Systems
    Tang Y.
    Wang F.
    Xie Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2019, 56 (04): : 767 - 778
  • [49] A Stack-Based Single Disk Failure Recovery Scheme for Erasure Coded Storage Systems
    Fu, Yingxun
    Shu, Jiwu
    Luo, Xianghong
    2014 IEEE 33RD INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS), 2014, : 136 - 145
  • [50] Popularity-based full replica caching for erasure-coded distributed storage systems
    Ruty, Guillaume
    Baccouch, Hana
    Nguyen, Victor
    Surcouf, Andre
    Rougier, Jean-Louis
    Boukhatem, Nadia
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2021, 24 (04): : 3173 - 3186