Multi-level federated learning based on cloud-edge-client collaboration and outlier-tolerance for fault diagnosis

被引:2
作者
Ma, Xue [1 ]
He, Xiao [1 ]
Wu, Xinyu [2 ]
Wen, Chenglin [3 ]
机构
[1] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
[2] Chinese Acad Sci, Guangdong Prov Key Lab Robot & Intelligent Syst, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[3] Guangdong Univ Petrochem Technol, Dept Automat, Maoming, Peoples R China
基金
中国国家自然科学基金;
关键词
cloud-edge-client collaboration; fault diagnosis; federated learning; level-by-level restricted sharing; outlier-tolerance;
D O I
10.1088/1361-6501/acf6d8
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The existing federated structure protects data privacy with only a certain level of confidentiality, and it is difficult to resist the reconstruction of other clients' data by malicious participants inside the federated and the illegal manipulation by external attackers or interceptors on the shared information. Besides, the average fusion algorithm used in the cloud center is difficult to eliminate the negative impact of outliers on model updates, and it cannot handle and fuse the time delay or even packet loss that occurs in the information obtained from each local client promptly. Therefore, to make the federated learning (FL) mechanism with stronger privacy protection ability and security, while effectively avoiding the negative impact of outliers on the aggregation of model parameters. We innovatively establish multi-Level FL based on cloud-edge-client collaboration and outlier-tolerance for fault diagnosis. At first, we build a multi-level FL network framework based on the cloud-edge-client collaborative approach for restricted sharing of network parameters level by level without data communication. Then, the edge-side performs Euclidean metrics on the restricted shared model parameters uploaded to the primary edge by each client, and uses them to identify outliers to evaluate and weight them for outlier-tolerance; Then, an outlier-tolerance mechanism is designed based on a centralized Kalman filtering algorithm that is to adjust the modeling error weights adaptively; Lastly, the cloud center performs asynchronous aggregation on the model parameters uploaded asynchronously by the highest-level edge based on a sequential Kalman filtering algorithm and transmitted the optimal model parameters back along the original path. Finally, the effectiveness of the proposed method is verified on the collected dataset.
引用
收藏
页数:15
相关论文
共 26 条
[1]   Highly efficient federated learning with strong privacy preservation in cloud computing [J].
Fang, Chen ;
Guo, Yuanbo ;
Wang, Na ;
Ju, Ankang .
COMPUTERS & SECURITY, 2020, 96
[2]   Iterative and sequential Kalman filter-based speech enhancement algorithms [J].
Gannot, S ;
Burshtein, D ;
Weinstein, E .
IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1998, 6 (04) :373-385
[3]   Federated Region-Learning for Environment Sensing in Edge Computing System [J].
Gao, Yujia ;
Liu, Liang ;
Hu, Binxuan ;
Lei, Tianzi ;
Ma, Huadong .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (04) :2192-2204
[4]  
Hard A, 2019, Arxiv, DOI arXiv:1811.03604
[5]   Federated Learning With Soft Clustering [J].
Li, Chengxi ;
Li, Gang ;
Varshney, Pramod K. .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (10) :7773-7782
[6]  
Li T, 2020, Arxiv, DOI arXiv:1812.06127
[7]   Federated Learning: Challenges, Methods, and Future Directions [J].
Li, Tian ;
Sahu, Anit Kumar ;
Talwalkar, Ameet ;
Smith, Virginia .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (03) :50-60
[8]   Keep Your Data Locally: Federated-Learning-Based Data Privacy Preservation in Edge Computing [J].
Liu, Gaoyang ;
Wang, Chen ;
Ma, Xiaoqiang ;
Yang, Yang .
IEEE NETWORK, 2021, 35 (02) :60-66
[9]   Accelerating Federated Learning via Momentum Gradient Descent [J].
Liu, Wei ;
Chen, Li ;
Chen, Yunfei ;
Zhang, Wenyi .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2020, 31 (08) :1754-1766
[10]   An Asynchronous and Real-Time Update Paradigm of Federated Learning for Fault Diagnosis [J].
Ma, Xue ;
Wen, Chenglin ;
Wen, Tao .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) :8531-8540