Multi-level federated learning based on cloud-edge-client collaboration and outlier-tolerance for fault diagnosis

被引:2
作者
Ma, Xue [1 ]
He, Xiao [1 ]
Wu, Xinyu [2 ]
Wen, Chenglin [3 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Chinese Acad Sci, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[3] Guangdong Univ Petrochem Technol, Dept Automat, Maoming, Peoples R China
基金
中国国家自然科学基金;
关键词
cloud-edge-client collaboration; fault diagnosis; federated learning; level-by-level restricted sharing; outlier-tolerance;
D O I
10.1088/1361-6501/acf6d8
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The existing federated structure protects data privacy with only a certain level of confidentiality, and it is difficult to resist the reconstruction of other clients' data by malicious participants inside the federated and the illegal manipulation by external attackers or interceptors on the shared information. Besides, the average fusion algorithm used in the cloud center is difficult to eliminate the negative impact of outliers on model updates, and it cannot handle and fuse the time delay or even packet loss that occurs in the information obtained from each local client promptly. Therefore, to make the federated learning (FL) mechanism with stronger privacy protection ability and security, while effectively avoiding the negative impact of outliers on the aggregation of model parameters. We innovatively establish multi-Level FL based on cloud-edge-client collaboration and outlier-tolerance for fault diagnosis. At first, we build a multi-level FL network framework based on the cloud-edge-client collaborative approach for restricted sharing of network parameters level by level without data communication. Then, the edge-side performs Euclidean metrics on the restricted shared model parameters uploaded to the primary edge by each client, and uses them to identify outliers to evaluate and weight them for outlier-tolerance; Then, an outlier-tolerance mechanism is designed based on a centralized Kalman filtering algorithm that is to adjust the modeling error weights adaptively; Lastly, the cloud center performs asynchronous aggregation on the model parameters uploaded asynchronously by the highest-level edge based on a sequential Kalman filtering algorithm and transmitted the optimal model parameters back along the original path. Finally, the effectiveness of the proposed method is verified on the collected dataset.
引用
收藏
页数:15
相关论文
共 26 条
[11]   Federated Learning-Based Cognitive Detection of Jamming Attack in Flying Ad-Hoc Network [J].
Mowla, Nishat, I ;
Tran, Nguyen H. ;
Doh, Inshil ;
Chae, Kijoon .
IEEE ACCESS, 2020, 8 :4338-4350
[12]   Privacy-Preserving Deep Learning via Additively Homomorphic Encryption [J].
Phong, Le Trieu ;
Aono, Yoshinori ;
Hayashi, Takuya ;
Wang, Lihua ;
Moriai, Shiho .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2018, 13 (05) :1333-1345
[13]   Internet of Things intrusion Detection: Centralized, On-Device, or Federated Learning? [J].
Rahman, Sawsan Abdul ;
Tout, Hanine ;
Talhi, Chamseddine ;
Mourad, Azzam .
IEEE NETWORK, 2020, 34 (06) :310-317
[14]   Mutual Information Driven Federated Learning [J].
Uddin, Md Palash ;
Xiang, Yong ;
Lu, Xuequan ;
Yearwood, John ;
Gao, Longxiang .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (07) :1526-1538
[15]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579
[16]  
Wang HY, 2020, Arxiv, DOI arXiv:2002.06440
[17]   Adaptive Federated Learning in Resource Constrained Edge Computing Systems [J].
Wang, Shiqiang ;
Tuor, Tiffany ;
Salonidis, Theodoros ;
Leung, Kin K. ;
Makaya, Christian ;
He, Ting ;
Chan, Kevin .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (06) :1205-1221
[18]   Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks [J].
Xia, Min ;
Li, Teng ;
Xu, Lin ;
Liu, Lizhi ;
de Silva, Clarence W. .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2018, 23 (01) :101-110
[19]   Federated Machine Learning for Intelligent IoT via Reconfigurable Intelligent Surface [J].
Yang, Kai ;
Shi, Yuanming ;
Zhou, Yong ;
Yang, Zhanpeng ;
Fu, Liqun ;
Chen, Wei .
IEEE NETWORK, 2020, 34 (05) :16-22
[20]  
Yang TMY, 2018, Arxiv, DOI arXiv:1812.02903