Data cube-based storage optimization for resource-constrained edge computing

被引:0
|
作者
Gao, Liyuan [1 ]
Li, Wenjing [1 ]
Ma, Hongyue [1 ]
Liu, Yumin [1 ]
Li, Chunyang [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing 102211, Peoples R China
来源
HIGH-CONFIDENCE COMPUTING | 2024年 / 4卷 / 04期
关键词
Edge computing; Data storage; Reliability; Compression efficiency; CODES; ARRAY;
D O I
10.1016/j.hcc.2024.100212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the evolving landscape of the digital era, edge computing emerges as an essential paradigm, especially critical for low-latency, real-time applications and Internet of Things (IoT) environments. Despite its advantages, edge computing faces severe limitations in storage capabilities and is fraught with reliability issues due to its resource-constrained nature and exposure to challenging conditions. To address these challenges, this work presents a tailored storage mechanism for edge computing, focusing on space efficiency and data reliability. Our method comprises three key steps: relation factorization, column clustering, and erasure encoding with compression. We successfully reduce the required storage space by deconstructing complex database tables and optimizing data organization within these sub-tables. We further add a layer of reliability through erasure encoding. Comprehensive experiments on TPC-H datasets substantiate our approach, demonstrating storage savings of up to 38.35% and time efficiency improvements by 3.96x in certain cases. Furthermore, our clustering technique shows a potential for additional storage reduction up to 40.41%. (c) 2024 The Author(s). Published by Elsevier B.V. on behalf of Shandong University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:8
相关论文
共 50 条
  • [41] Exploring the use of blockchain in resource-constrained fog computing environments
    Sanchez-de la Rosa, Miguel
    Nunez-Gomez, Carlos
    Blanca Caminero, M.
    Carrion, Carmen
    SOFTWARE-PRACTICE & EXPERIENCE, 2023, 53 (04): : 971 - 987
  • [42] Seismic Waveform Inversion Capability on Resource-Constrained Edge Devices
    Manu, Daniel
    Tshakwanda, Petro Mushidi
    Lin, Youzuo
    Jiang, Weiwen
    Yang, Lei
    JOURNAL OF IMAGING, 2022, 8 (12)
  • [43] TinyTate: computing the tate pairing in resource-constrained sensor nodes
    Oliveira, Leonardo B.
    Aranha, Diego F.
    Morais, Eduardo
    Daguano, Felipe
    SIXTH IEEE INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS, PROCEEDINGS, 2007, : 318 - 323
  • [44] Optimizing Edge AI: Performance Engineering in Resource-Constrained Environments
    Casale, Giuliano
    PROCEEDINGS OF THE 15TH ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, ICPE 2024, 2024, : 223 - 223
  • [45] Large Scale Stream Analytics using a Resource-constrained Edge
    Das, Roshan Bharath
    Di Bernardo, Gabriele
    Bal, Henri
    2018 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING (IEEE EDGE), 2018, : 135 - 139
  • [46] Ant colony optimization for resource-constrained project scheduling
    Merkle, D
    Middendorf, M
    Schmeck, H
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (04) : 333 - 346
  • [47] An Effective Approach for Resource-Constrained Edge Devices in Federated Learning
    Wen, Jun
    Li, Xiusheng
    Chen, Yupeng
    Li, Xiaoli
    Mao, Hang
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [48] Optimization of Task Allocation for Resource-Constrained Swarm Robots
    Kang, Woosuk
    Jeong, Eunjin
    Shim, Sungjun
    Ha, Soonhoi
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 3068 - 3085
  • [49] Distributed control and optimization with resource-constrained networked systems
    He, Jianping
    Cheng, Peng
    Wu, Junfeng
    Freris, Nikolaos
    Zeng, Peng
    NEUROCOMPUTING, 2017, 270 : 1 - 3
  • [50] Optimization of Resource-Constrained Project Using Genetic Algorithm
    Ahmed, Sweilam
    Berlant, Arab
    Omar, Sawan
    Yasmeen, Essawy
    Osama, Hosny
    PROCEEDINGS OF THE CANADIAN SOCIETY FOR CIVIL ENGINEERING ANNUAL CONFERENCE, VOL 3, CSCE 2023, 2024, 497 : 481 - 492