Adaptive Federated Learning and Digital Twin for Industrial Internet of Things

被引:224
作者
Sun, Wen [1 ]
Lei, Shiyu [2 ]
Wang, Lu [2 ]
Liu, Zhiqiang [1 ]
Zhang, Yan [3 ,4 ]
机构
[1] Northwestern Polytech Univ, Sch Cybersecur, Xian 710072, Peoples R China
[2] Xidian Univ, Sch Cyber Engn, Xian 710071, Peoples R China
[3] Univ Oslo, N-0316 Oslo, Norway
[4] Simula Metropolitan Ctr Digital Engn, N-0167 Oslo, Norway
基金
欧盟地平线“2020”; 中国国家自然科学基金;
关键词
Collaborative work; Training; Data models; Digital twin; Computer architecture; Convergence; Asynchronous; communication efficiency; digital twin (DT); federated learning; learning efficiency;
D O I
10.1109/TII.2020.3034674
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Industrial Internet of Things (IoT) enables distributed intelligent services varying with the dynamic and realtime industrial environment to achieve Industry 4.0 benefits. In this article, we consider a new architecture of digital twin (DT) empowered Industrial IoT, where DTs capture the characteristics of industrial devices to assist federated learning. Noticing that DTs may bring estimation deviations from the actual value of device state, a trusted-based aggregation is proposed in federated learning to alleviate the effects of such deviation. We adaptively adjust the aggregation frequency of federated learning based on Lyapunov dynamic deficit queue and deep reinforcement learning (DRL), to improve the learning performance under the resource constraints. To further adapt to the heterogeneity of industrial IoT, a clustering-based asynchronous federated learning framework is proposed. Numerical results show that the proposed framework is superior to the benchmark in terms of learning accuracy, convergence, and energy saving.
引用
收藏
页码:5605 / 5614
页数:10
相关论文
共 19 条
[1]   Robust Federated Learning With Noisy Communication [J].
Ang, Fan ;
Chen, Li ;
Zhao, Nan ;
Chen, Yunfei ;
Wang, Weidong ;
Yu, F. Richard .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (06) :3452-3464
[2]   Zero Knowledge Clustering Based Adversarial Mitigation in Heterogeneous Federated Learning [J].
Chen, Zheyi ;
Tian, Pu ;
Liao, Weixian ;
Yu, Wei .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (02) :1070-1083
[3]   Federated Learning With Multichannel ALOHA [J].
Choi, Jinho ;
Pokhrel, Shiva Raj .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2020, 9 (04) :499-502
[4]   HCP: Heterogeneous Computing Platform for Federated Learning Based Collaborative Content Caching Towards 6G Networks [J].
Fadlullah, Zubair Md ;
Kato, Nei .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2022, 10 (01) :112-123
[5]   Efficient and Privacy-Enhanced Federated Learning for Industrial Artificial Intelligence [J].
Hao, Meng ;
Li, Hongwei ;
Luo, Xizhao ;
Xu, Guowen ;
Yang, Haomiao ;
Liu, Sen .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (10) :6532-6542
[6]   Design Techniques and Applications of Cyberphysical Systems: A Survey [J].
Khaitan, Siddhartha Kumar ;
McCalley, James D. .
IEEE SYSTEMS JOURNAL, 2015, 9 (02) :350-365
[7]   Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT [J].
Lu, Yunlong ;
Huang, Xiaohong ;
Dai, Yueyue ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (06) :4177-4186
[8]   Differentially Private Asynchronous Federated Learning for Mobile Edge Computing in Urban Informatics [J].
Lu, Yunlong ;
Huang, Xiaohong ;
Dai, Yueyue ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (03) :2134-2143
[9]  
Nishio T, 2019, IEEE ICC
[10]   A Crowdsourcing Framework for On-Device Federated Learning [J].
Pandey, Shashi Raj ;
Tran, Nguyen H. ;
Bennis, Mehdi ;
Tun, Yan Kyaw ;
Manzoor, Aunas ;
Hong, Choong Seon .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (05) :3241-3256