Data cube-based storage optimization for resource-constrained edge computing

被引:0
|
作者
Gao, Liyuan [1 ]
Li, Wenjing [1 ]
Ma, Hongyue [1 ]
Liu, Yumin [1 ]
Li, Chunyang [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing 102211, Peoples R China
来源
HIGH-CONFIDENCE COMPUTING | 2024年 / 4卷 / 04期
关键词
Edge computing; Data storage; Reliability; Compression efficiency; CODES; ARRAY;
D O I
10.1016/j.hcc.2024.100212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the evolving landscape of the digital era, edge computing emerges as an essential paradigm, especially critical for low-latency, real-time applications and Internet of Things (IoT) environments. Despite its advantages, edge computing faces severe limitations in storage capabilities and is fraught with reliability issues due to its resource-constrained nature and exposure to challenging conditions. To address these challenges, this work presents a tailored storage mechanism for edge computing, focusing on space efficiency and data reliability. Our method comprises three key steps: relation factorization, column clustering, and erasure encoding with compression. We successfully reduce the required storage space by deconstructing complex database tables and optimizing data organization within these sub-tables. We further add a layer of reliability through erasure encoding. Comprehensive experiments on TPC-H datasets substantiate our approach, demonstrating storage savings of up to 38.35% and time efficiency improvements by 3.96x in certain cases. Furthermore, our clustering technique shows a potential for additional storage reduction up to 40.41%. (c) 2024 The Author(s). Published by Elsevier B.V. on behalf of Shandong University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Supervised Compression for Resource-Constrained Edge Computing Systems
    Matsubara, Yoshitomo
    Yang, Ruihan
    Levorato, Marco
    Mandt, Stephan
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 923 - 933
  • [2] Adaptive Asynchronous Federated Learning in Resource-Constrained Edge Computing
    Liu, Jianchun
    Xu, Hongli
    Wang, Lun
    Xu, Yang
    Qian, Chen
    Huang, Jinyang
    Huang, He
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (02) : 674 - 690
  • [3] Knowledge Distillation in Object Detection for Resource-Constrained Edge Computing
    Setyanto, Arief
    Sasongko, Theopilus Bayu
    Fikri, Muhammad Ainul
    Ariatmanto, Dhani
    Agastya, I. Made Artha
    Rachmanto, Rakandhiya Daanii
    Ardana, Affan
    Kim, In Kee
    IEEE ACCESS, 2025, 13 : 18200 - 18214
  • [4] Adaptive Quality Optimization of Computer Vision Tasks in Resource-Constrained Devices using Edge Computing
    Toma, Anas
    Wenner, Juri
    Lenssen, Jan Eric
    Chen, Jian-Jia
    2019 19TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2019, : 469 - 477
  • [5] DQN based Blockchain Data Storage in Resource-constrained IoT System
    Lei, Boyi
    Zhou, Jianhong
    Ma, Maode
    Niu, Xianhua
    2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC, 2023,
  • [6] Resource-Constrained Serial Task Offload Strategy in Mobile Edge Computing
    Liu W.
    Huang Y.-C.
    Du W.
    Wang W.
    Ruan Jian Xue Bao/Journal of Software, 2020, 31 (06): : 1889 - 1908
  • [7] Computation Offloading in Resource-Constrained Multi-Access Edge Computing
    Li, Kexin
    Wang, Xingwei
    He, Qiang
    Wang, Jielei
    Li, Jie
    Zhan, Siyu
    Lu, Guoming
    Dustdar, Schahram
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (11) : 10665 - 10677
  • [8] Adaptive Batch Size for Federated Learning in Resource-Constrained Edge Computing
    Ma, Zhenguo
    Xu, Yang
    Xu, Hongli
    Meng, Zeyu
    Huang, Liusheng
    Xue, Yinxing
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) : 37 - 53
  • [9] To Compute or Not to Compute? Adaptive Smart Sensing in Resource-Constrained Edge Computing
    Ballotta, Luca
    Peserico, Giovanni
    Zanini, Francesco
    Dini, Paolo
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (01): : 736 - 749
  • [10] Communication-efficient asynchronous federated learning in resource-constrained edge computing
    Liu, Jianchun
    Xu, Hongli
    Xu, Yang
    Ma, Zhenguo
    Wang, Zhiyuan
    Qian, Chen
    Huang, He
    COMPUTER NETWORKS, 2021, 199