Federated Transfer Learning for Bearing Fault Diagnosis With Discrepancy-Based Weighted Federated Averaging

被引:77
作者
Chen, Junbin [1 ]
Li, Jipu [1 ]
Huang, Ruyi [2 ]
Yue, Ke [1 ]
Chen, Zhuyun [1 ]
Li, Weihua [2 ]
机构
[1] South China Univ Technol, Sch Mech & Automot Engn, Guangzhou 510640, Peoples R China
[2] South China Univ Technol, Shien Ming Wu Sch Intelligent Engn, Guangzhou 510640, Peoples R China
基金
中国国家自然科学基金;
关键词
Data models; Training; Fault diagnosis; Transfer learning; Collaborative work; Machinery; Data privacy; Ball bearings; fault diagnosis; federated transfer learning (FTL); maximum mean discrepancy (MMD); weighted federated averaging (WFA); MACHINERY; NETWORK;
D O I
10.1109/TIM.2022.3180417
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Generally, high performance of deep learning (DL)-based machinery fault diagnosis methods relies on abundant labeled fault samples under various working conditions, while they are usually stored by different users and not communicated with each other due to data privacy protection. Federated learning (FL) is a possible solution, but the traditional federated averaging (FedAvg) algorithm in FL ignores the potential domain shift of different FL participants, which limits its further application. Therefore, a federated transfer learning (FTL) framework with discrepancy-based weighted federated averaging (D-WFA) is proposed to train the good global diagnosis model collaboratively as well as protect data privacy. First, local labeled source domain data and unlabeled target domain data are utilized to update multiple local models with generalization ability. Then, a maximum mean discrepancy (MMD)-based dynamic weighted averaging algorithm is designed to aggregate the updated local models with automatically learned weight. The proposed D-WFA overcomes the disadvantage of the traditional FedAvg algorithm, which assumes that all clients have the same contribution in constructing the global model during FL training. Experiment results on a bearing dataset show that the proposed D-WFA outperforms the traditional FedAvg and relative FTL method, which offers a promising solution in privacy-preserving machine learning for fault diagnosis.
引用
收藏
页数:11
相关论文
共 26 条
  • [21] Federated Machine Learning: Concept and Applications
    Yang, Qiang
    Liu, Yang
    Chen, Tianjian
    Tong, Yongxin
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (02)
  • [22] Yang W., 2021, 2021 GLOBAL RELIABIL, P1
  • [23] Federated Transfer Learning for Intelligent Fault Diagnostics Using Deep Adversarial Networks With Data Privacy
    Zhang, Wei
    Li, Xiang
    [J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2022, 27 (01) : 430 - 439
  • [24] Data privacy preserving federated transfer learning in machinery fault diagnostics using prior distributions
    Zhang, Wei
    Li, Xiang
    [J]. STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2022, 21 (04): : 1329 - 1344
  • [25] Federated learning for machinery fault diagnosis with dynamic validation and self-supervision
    Zhang, Wei
    Li, Xiang
    Ma, Hui
    Luo, Zhong
    Li, Xu
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 213
  • [26] Zhao ZB, 2021, CHIN J MECH ENG-EN, V34, DOI 10.1186/s10033-021-00570-7