Lightweight FL: A Low-Cost Federated Learning Framework for Mechanical Fault Diagnosis With Training Optimization and Model Pruning

被引:8
作者
Du, Jiahao [1 ]
Qin, Na [1 ]
Huang, Deqing [1 ]
Jia, Xinming [1 ]
Zhang, Yiming [1 ]
机构
[1] Southwest Jiaotong Univ, Inst Syst Sci & Technol, Sch Elect Engn, Chengdu 611756, Peoples R China
关键词
Computation and communication costs; deep learning; fault diagnosis; lightweight federated learning (FL); SPIN-EXCHANGE; MEG;
D O I
10.1109/TIM.2023.3328073
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to data security concerns, federated learning (FL) has significant computation and communication costs, which lowers total training effectiveness. This research proposes a new FL framework, Lightweight FL, to resolve this problem by enhancing the current fundamental processes. First, a local network comprising numerous lightweight training methodologies is designed to lower the costs of local model training via small-scale convolution calculation. Second, nonstructural pruning and fine-tuning of the local model is performed on this premise to reduce computation costs by reducing network complexity. Third, the optimal selection strategy is proposed during model pruning and model aggregation processes, and the model with the best performance is chosen as the benchmark model for the next iteration of learning. This strategy is equipped to reduce communication costs and improve the learning efficiency of the framework. It is proved through verification of the bearing, gearbox, and bogie datasets that it can effectively decrease learning costs while still assuring good model performance. This offers a workable option for FL deployments in the future on low-performance edge devices.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 45 条
  • [1] MULTICHANNEL SQUID SYSTEMS FOR BRAIN RESEARCH
    AHONEN, AI
    HAMALAINEN, MS
    KAJOLA, MJ
    KNUUTILA, JET
    LOUNASMAA, OV
    SIMOLA, JT
    TESCHE, CD
    VILKMAN, VA
    [J]. IEEE TRANSACTIONS ON MAGNETICS, 1991, 27 (02) : 2786 - 2792
  • [2] High-sensitivity atomic magnetometer unaffected by spin-exchange relaxation
    Allred, JC
    Lyman, RN
    Kornack, TW
    Romalis, MV
    [J]. PHYSICAL REVIEW LETTERS, 2002, 89 (13) : 130801 - 130801
  • [3] Cross-Axis projection error in optically pumped magnetometers and its implication for magnetoencephalography systems
    Borna, Amir
    Iivanainen, Joonas
    Carter, Tony R.
    McKay, Jim
    Taulu, Samu
    Stephen, Julia
    Schwindt, Peter D. D.
    [J]. NEUROIMAGE, 2022, 247
  • [4] A 20-channel magnetoencephalography system based on optically pumped magnetometers
    Borna, Amir
    Carter, Tony R.
    Goldberg, Josh D.
    Colombo, Anthony P.
    Jau, Yuan-Yu
    Berry, Christopher
    Mckay, Jim
    Stephen, Julia
    Weisend, Michael
    Schwindt, Peter D. D.
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2017, 62 (23) : 8909 - 8923
  • [5] Moving magnetoencephalography towards real-world applications with a wearable system
    Boto, Elena
    Holmes, Niall
    Leggett, James
    Roberts, Gillian
    Shah, Vishal
    Meyer, Sofie S.
    Munoz, Leonardo Duque
    Mullinger, Karen J.
    Tierney, Tim M.
    Bestmann, Sven
    Barnes, Gareth R.
    Bowtell, Richard
    Brookes, Matthew J.
    [J]. NATURE, 2018, 555 (7698) : 657 - +
  • [6] Ding Z., 2022, IEEE Trans. Instrum. Meas., V71, P1
  • [7] Ding Z., 2023, IEEE Trans. Instrum. Meas., V72, P1
  • [8] Atomic-Signal-Based Zero-Field Finding Technique for Unshielded Atomic Vector Magnetometer
    Dong, Haifeng
    Lin, Hongbo
    Tang, Xinbin
    [J]. IEEE SENSORS JOURNAL, 2013, 13 (01) : 186 - 189
  • [9] Dupont-Roc J., 1970, Revue de Physique Appliquee, V5, P853, DOI 10.1051/rphysap:0197000506085300
  • [10] How to build a magnetometer with thermal atomic vapor: a tutorial
    Fabricant, Anne
    Novikova, Irina
    Bison, Georg
    [J]. NEW JOURNAL OF PHYSICS, 2023, 25 (02):