Node Selection Algorithm for Federated Learning Based on Deep Reinforcement Learning for Edge Computing in IoT

被引:5
作者
Yan, Shuai [1 ,2 ]
Zhang, Peiying [3 ,4 ]
Huang, Siyu [5 ]
Wang, Jian [6 ]
Sun, Hao [3 ]
Zhang, Yi [3 ]
Tolba, Amr [7 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Peoples R China
[2] Natl Univ Def Technol, Coll Informat & Commun, Wuhan 430000, Peoples R China
[3] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[4] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[5] Chinese Acad Sci, Xiongan Inst Innovat, Baoding 071702, Peoples R China
[6] China Univ Petr East China, Coll Sci, Qingdao 266580, Peoples R China
[7] King Saud Univ, Community Coll, Dept Comp Sci, Riyadh 11437, Saudi Arabia
关键词
IoT; edge computing; federated learning; node selection; reinforcement learning; RESOURCE-ALLOCATION; CHALLENGES; INTERNET;
D O I
10.3390/electronics12112478
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Internet of Things (IoT) and edge computing technologies have been rapidly developing in recent years, leading to the emergence of new challenges in privacy and security. Personal privacy and data leakage have become major concerns in IoT edge computing environments. Federated learning has been proposed as a solution to address these privacy issues, but the heterogeneity of devices in IoT edge computing environments poses a significant challenge to the implementation of federated learning. To overcome this challenge, this paper proposes a novel node selection strategy based on deep reinforcement learning to optimize federated learning in heterogeneous device IoT environments. Additionally, a metric model for IoT devices is proposed to evaluate the performance of different devices. The experimental results demonstrate that the proposed method can improve training accuracy by 30% in a heterogeneous device IoT environment.
引用
收藏
页数:14
相关论文
共 38 条
[1]  
[Anonymous], 2015, White Paper
[2]  
Bowo W.A., 2019, P 2019 4 INT C INF C, P1, DOI [10.1109/ICIC47613.2019.8985896, DOI 10.1109/ICIC47613.2019.8985896]
[3]   Edge Intelligence: The Confluence of Edge Computing and Artificial Intelligence [J].
Deng, Shuiguang ;
Zhao, Hailiang ;
Fang, Weijia ;
Yin, Jianwei ;
Dustdar, Schahram ;
Zomaya, Albert Y. .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (08) :7457-7469
[4]   Analog Gradient Aggregation for Federated Learning Over Wireless Networks: Customized Design and Convergence Analysis [J].
Guo, Huayan ;
Liu, An ;
Lau, Vincent K. N. .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (01) :197-210
[5]   From Federated to Fog Learning: Distributed Machine Learning over Heterogeneous Wireless Networks [J].
Hosseinalipour, Seyyedali ;
Brinton, Christopher G. ;
Aggarwal, Vaneet ;
Dai, Huaiyu ;
Chiang, Mung .
IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (12) :41-47
[6]   How to train your robot with deep reinforcement learning: lessons we have learned [J].
Ibarz, Julian ;
Tan, Jie ;
Finn, Chelsea ;
Kalakrishnan, Mrinal ;
Pastor, Peter ;
Levine, Sergey .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2021, 40 (4-5) :698-721
[7]   Federated Learning for Internet of Things: Recent Advances, Taxonomy, and Open Challenges [J].
Khan, Latif U. ;
Saad, Walid ;
Han, Zhu ;
Hossain, Ekram ;
Hong, Choong Seon .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2021, 23 (03) :1759-1799
[8]   Deep Reinforcement Learning for Autonomous Driving: A Survey [J].
Kiran, B. Ravi ;
Sobh, Ibrahim ;
Talpaert, Victor ;
Mannion, Patrick ;
Al Sallab, Ahmad A. ;
Yogamani, Senthil ;
Perez, Patrick .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (06) :4909-4926
[9]  
Konečny J, 2017, Arxiv, DOI [arXiv:1610.05492, 10.48550/arXiv.1610.05492, DOI 10.48550/ARXIV.1610.05492]
[10]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324