Data cube-based storage optimization for resource-constrained edge computing

被引:0
|
作者
Gao, Liyuan [1 ]
Li, Wenjing [1 ]
Ma, Hongyue [1 ]
Liu, Yumin [1 ]
Li, Chunyang [1 ]
机构
[1] State Grid Informat & Telecommun Grp Co Ltd, Beijing 102211, Peoples R China
来源
HIGH-CONFIDENCE COMPUTING | 2024年 / 4卷 / 04期
关键词
Edge computing; Data storage; Reliability; Compression efficiency; CODES; ARRAY;
D O I
10.1016/j.hcc.2024.100212
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the evolving landscape of the digital era, edge computing emerges as an essential paradigm, especially critical for low-latency, real-time applications and Internet of Things (IoT) environments. Despite its advantages, edge computing faces severe limitations in storage capabilities and is fraught with reliability issues due to its resource-constrained nature and exposure to challenging conditions. To address these challenges, this work presents a tailored storage mechanism for edge computing, focusing on space efficiency and data reliability. Our method comprises three key steps: relation factorization, column clustering, and erasure encoding with compression. We successfully reduce the required storage space by deconstructing complex database tables and optimizing data organization within these sub-tables. We further add a layer of reliability through erasure encoding. Comprehensive experiments on TPC-H datasets substantiate our approach, demonstrating storage savings of up to 38.35% and time efficiency improvements by 3.96x in certain cases. Furthermore, our clustering technique shows a potential for additional storage reduction up to 40.41%. (c) 2024 The Author(s). Published by Elsevier B.V. on behalf of Shandong University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:8
相关论文
共 50 条
  • [21] Policy Learning in Resource-Constrained Optimization
    Allmendinger, Richard
    Knowles, Joshua
    GECCO-2011: PROCEEDINGS OF THE 13TH ANNUAL GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2011, : 1971 - 1978
  • [22] Path Optimization for the Resource-Constrained Searcher
    Sato, Hiroyuki
    Royset, Johannes O.
    NAVAL RESEARCH LOGISTICS, 2010, 57 (05) : 422 - 440
  • [23] Learning-Driven Decentralized Machine Learning in Resource-Constrained Wireless Edge Computing
    Meng, Zeyu
    Xu, Hongli
    Chen, Min
    Xu, Yang
    Zhao, Yangming
    Qia, Chunming
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
  • [24] TreeNet Based Fast Task Decomposition for Resource-Constrained Edge Intelligence
    Lu, Dong
    Zhai, Yanlong
    Shen, Jun
    Fahmideh, Mahdi
    Wu, Jianqing
    Tchaye-Kondi, Jude
    Zhu, Liehuang
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2023, 16 (03) : 2254 - 2266
  • [25] Operating theatre optimization : A resource-constrained based solving approach
    Roland, Benoit
    Di Martinelly, Christine
    Riane, Fouad
    2006 INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT, VOLS 1 AND 2, PROCEEDINGS, 2006, : 443 - 448
  • [26] Lightweight blockchain consensus mechanism and storage optimization for resource-constrained IoT devices
    Li, Chunlin
    Zhang, Jing
    Yang, Xianmin
    Luo Youlong
    INFORMATION PROCESSING & MANAGEMENT, 2021, 58 (04)
  • [27] Blockchain at the Edge: Performance of Resource-Constrained IoT Networks
    Misra, Sudip
    Mukherjee, Anandarup
    Roy, Arijit
    Saurabh, Nishant
    Rahulamathavan, Yogachandran
    Rajarajan, Muttukrishnan
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (01) : 174 - 183
  • [28] Hierarchical Ensemble Reduction and Learning for Resource-constrained Computing
    Wang, Hongfei
    Li, Jianwen
    He, Kun
    ACM TRANSACTIONS ON DESIGN AUTOMATION OF ELECTRONIC SYSTEMS, 2020, 25 (01)
  • [29] Machine Learning and Optimization for Resource-Constrained Platforms
    Barnes, Patrick
    Murawski, Robert
    2019 IEEE COGNITIVE COMMUNICATIONS FOR AEROSPACE APPLICATIONS WORKSHOP (CCAAW), 2019,
  • [30] Resource-Constrained Neural Architecture Search on Edge Devices
    Lyu, Bo
    Yuan, Hang
    Lu, Longfei
    Zhang, Yunye
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (01): : 134 - 142