On the Optimality of Data Exchange for Master-Aided Edge Computing Systems

被引:2
作者
Chen, Haoning [1 ]
Long, Junfeng [1 ]
Ma, Shuai [2 ]
Tang, Mingjian [3 ]
Wu, Youlong [1 ]
机构
[1] Shanghai Tech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Peoples R China
[3] Westpac Banking Corp, Sydney, NSW 2000, Australia
关键词
Distributed computing; MapReduce; computation; communication; FUNDAMENTAL LIMITS; PERFORMANCE;
D O I
10.1109/TCOMM.2023.3238373
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Edge computing has recently garnered significant interest in many Internet of Things (IoT) applications. However, the excessive overhead during data exchange still remains an open challenge, especially for large-scale data processing tasks. This paper considers a master-aided distributed computing system with multiple edge computing nodes and a master node, where the master node helps edge nodes compute output functions. We propose a coded scheme to reduce the communication latency by exploiting computation and communication capabilities of all nodes and creating coded multicast opportunities. More importantly, we prove that the proposed scheme is always optimal, i.e., achieving the minimum communication latency, for arbitrary computing and storage abilities at the master. This extends the previous optimality results in the extreme cases (either the master could compute all input files or compute nothing) to the general case. Finally, numerical results and TeraSort experiments demonstrate that our schemes can greatly reduce the communication latency compared with the existing schemes.
引用
收藏
页码:1364 / 1376
页数:13
相关论文
共 50 条
  • [21] AoI-Aware Joint Resource Allocation in Multi-UAV Aided Multi-Access Edge Computing Systems
    Shen, Shuai
    Yang, Halvin
    Yang, Kun
    Wang, Kezhi
    Zhang, Guopeng
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (03): : 2596 - 2609
  • [22] Data Locality in High Performance Computing, Big Data, and Converged Systems: An Analysis of the Cutting Edge and a Future System Architecture
    Usman, Sardar
    Mehmood, Rashid
    Katib, Iyad
    Albeshri, Aiiad
    ELECTRONICS, 2023, 12 (01)
  • [23] Nebula: Distributed Edge Cloud for Data Intensive Computing
    Ryden, Mathew
    Oh, Kwangsung
    Chandra, Abhishek
    Weissman, Jon
    2014 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E), 2014, : 57 - 66
  • [24] Leveraging Cloud Infrastructure for Troubleshooting Edge Computing Systems
    Fagan, Michael
    Khan, Mohammad Maifi Hasan
    Wang, Bing
    PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 440 - 447
  • [25] Convergence of Recommender Systems and Edge Computing: A Comprehensive Survey
    Sun, Chuan
    Li, Hui
    Li, Xiuhua
    Wen, Junhao
    Xiong, Qingyu
    Zhou, Wei
    IEEE ACCESS, 2020, 8 (08): : 47118 - 47132
  • [26] On the Design of Federated Learning in the Mobile Edge Computing Systems
    Feng, Chenyuan
    Zhao, Zhongyuan
    Wang, Yidong
    Quek, Tony Q. S.
    Peng, Mugen
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 5902 - 5916
  • [27] Nebula: Distributed Edge Cloud for Data Intensive Computing
    Jonathan, Albert
    Ryden, Mathew
    Oh, Kwangsung
    Chandra, Abhishek
    Weissman, Jon
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2017, 28 (11) : 3229 - 3242
  • [28] Deep Learning Enabled Data Offloading With Cyber Attack Detection Model in Mobile Edge Computing Systems
    Gopalakrishnan, T.
    Ruby, D.
    Al-Turjman, Fadi
    Gupta, Deepak
    Pustokhina, Irina V.
    Pustokhin, Denis A.
    Shankar, K.
    IEEE ACCESS, 2020, 8 : 185938 - 185949
  • [29] Security Efficiency Maximization for Multi-UAV-Aided Network With Mobile Edge Computing
    Mu, Guangchen
    FRONTIERS IN COMPUTER SCIENCE, 2021, 3
  • [30] Joint Offloading and Computing Optimization in Wireless Powered Mobile-Edge Computing Systems
    Wang, Feng
    Xu, Jie
    Wang, Xin
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (03) : 1784 - 1797