Federated Learning-Based Computation Offloading Optimization in Edge Computing-Supported Internet of Things

被引:136
作者
Ren, Jianji [1 ]
Wang, Haichao [1 ]
Hou, Tingting [1 ]
Zheng, Shuai [1 ]
Tang, Chaosheng [1 ]
机构
[1] Henan Polytech Univ, Software Coll, Coll Comp Sci & Technol, Jiaozuo 454010, Henan, Peoples R China
关键词
Federated learning; computation offloading; IoT; edge computing;
D O I
10.1109/ACCESS.2019.2919736
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, smart cities, smart homes, and smart medical systems have challenged the functionality and connectivity of the large-scale Internet of Things (IoT) devices. Thus, with the idea of offloading intensive computing tasks from them to edge nodes (ENs), edge computing emerged to supplement these limited devices. Benefit from this advantage, IoT devices can save more energy and still maintain the quality of the services they should provide. However, computational offload decisions involve federation and complex resource management and should be determined in the real-time face to dynamic workloads and radio environments. Therefore, in this work, we use multiple deep reinforcement learning (DRL) agents deployed on multiple edge nodes to indicate the decisions of the IoT devices. On the other hand, with the aim of making DRL-based decisions feasible and further reducing the transmission costs between the IoT devices and edge nodes, federated learning (FL) is used to train DRL agents in a distributed fashion. The experimental results demonstrate the effectiveness of the decision scheme and federated learning in the dynamic IoT system.
引用
收藏
页码:69194 / 69201
页数:8
相关论文
共 17 条
[1]  
[Anonymous], 2018, ARXIV180907857
[2]   Processor design for portable systems [J].
Burd, TD ;
Brodersen, RW .
JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 1996, 13 (2-3) :203-221
[3]   Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network [J].
Chen, Min ;
Hao, Yixue .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (03) :587-597
[4]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[5]   Efficient Multi-User Computation Offloading for Mobile-Edge Cloud Computing [J].
Chen, Xu ;
Jiao, Lei ;
Li, Wenzhong ;
Fu, Xiaoming .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2016, 24 (05) :2827-2840
[6]   Hierarchical Edge Caching in Device-to-Device Aided Mobile Networks: Modeling, Optimization, and Design [J].
Li, Xiuhua ;
Wang, Xiaofei ;
Wan, Peng-Jun ;
Han, Zhu ;
Leung, Victor C. M. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (08) :1768-1785
[7]   Collaborative Multi-Tier Caching in Heterogeneous Networks: Modeling, Analysis, and Design [J].
Li, Xiuhua ;
Wang, Xiaofei ;
Li, Keqiu ;
Han, Zhu ;
Leung, Victor C. M. .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2017, 16 (10) :6926-6939
[8]  
McMahan H. B., 2017, P 20 INT C ART INT S, P1
[9]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[10]   SIGMM: A Novel Machine Learning Algorithm for Spammer Identification in Industrial Mobile Cloud Computing [J].
Qiu, Tie ;
Wang, Heyuan ;
Li, Keqiu ;
Ning, Huansheng ;
Sangaiah, Arun Kumar ;
Chen, Baochao .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2019, 15 (04) :2349-2359