Resource Management for MEC Assisted Multi-Layer Federated Learning Framework

被引:2
作者
Li, Huibo [1 ]
Pan, Yijin [2 ]
Zhu, Huiling [3 ]
Gong, Peng [1 ]
Wang, Jiangzhou [3 ]
机构
[1] Beijing Inst Technol, Sch Mechatron Engn, Beijing 100081, Peoples R China
[2] Southeast Univ, Natl Mobile Commun Res Lab, Nanjing 211111, Peoples R China
[3] Univ Kent, Sch Engn, Canterbury CT2 7NT, England
基金
中国国家自然科学基金;
关键词
Federated learning; mobile edge computing; cloud radio access network; resource allocation; SDR method; SEMIDEFINITE RELAXATION; COMMUNICATION; ALLOCATION;
D O I
10.1109/TWC.2023.3327809
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, a mobile edge computing (MEC) assisted multi-layer architecture is proposed to support the implementation of federated learning in Internet of Things (IoT) networks. In this architecture, when performing a federated learning based task, data samples can be partially offloaded to MEC servers and cloud server rather than only processing the task at the IoT devices. After collecting local model parameters from devices and MEC servers, cloud server makes an aggregation and broadcasts it back to all devices. An optimization problem is presented to minimize the total federated training latency by jointly optimizing decisions on data offloading ratio, computation resource allocation and bandwidth allocation. To solve the formulated NP hard problem, the optimization problem is converted into quadratically constrained quadratic program (QCQP) and an efficient algorithm is proposed based on semidefinite relaxation (SDR) method. Furthermore, the scenario with the constraint of indivisible tasks in devices is considered and an applicable algorithm is proposed to get effective offloading decisions. Simulation results show that the proposed solutions can get effective resource allocation strategy and the proposed multi-layer federated learning architecture outperforms the conventional federated learning scheme in terms of the learning latency performance.
引用
收藏
页码:5680 / 5693
页数:14
相关论文
共 36 条
[1]   Unbounded knapsack problem: Dynamic programming revisited [J].
Andonov, R ;
Poirriez, V ;
Rajopadhye, S .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2000, 123 (02) :394-407
[2]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[3]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[4]  
Chu YW, 2024, Arxiv, DOI arXiv:2212.02985
[5]   IoT Application Modules Placement and Dynamic Task Processing in Edge-Cloud Computing [J].
Fang, Juan ;
Ma, Aonan .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (16) :12771-12781
[6]   Blockchained On-Device Federated Learning [J].
Kim, Hyesung ;
Park, Jihong ;
Bennis, Mehdi ;
Kim, Seong-Lyun .
IEEE COMMUNICATIONS LETTERS, 2020, 24 (06) :1279-1283
[7]   Semi-stochastic coordinate descent [J].
Konecny, Jakub ;
Qu, Zheng ;
Richtarik, Peter .
OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (05) :993-1005
[8]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444
[9]   Edge AI: On-Demand Accelerating Deep Neural Network Inference via Edge Computing [J].
Li, En ;
Zeng, Liekang ;
Zhou, Zhi ;
Chen, Xu .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) :447-457
[10]   Multi-key privacy-preserving deep learning in cloud computing [J].
Li, Ping ;
Li, Jin ;
Huang, Zhengan ;
Li, Tong ;
Gao, Chong-Zhi ;
Yiu, Siu-Ming ;
Chen, Kai .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 74 :76-85