Community Awareness Personalized Federated Learning for Defect Detection

被引:0
作者
Zhao, Hongwei [1 ,2 ]
Liu, Qiyuan [1 ,2 ]
Sun, Haoyun [1 ,2 ]
Xu, Liang [3 ]
Zhang, Weishan [1 ,2 ]
Zhao, Yikang [1 ,2 ]
Wang, Fei-Yue [4 ,5 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Shandong Data Open Innovat Applicat Lab, Qingdao 266580, Peoples R China
[3] Beijing Univ Sci & Technol, Coll Comp Sci & Technol, Beijing 100083, Peoples R China
[4] Chinese Acad Sci, Beijing 100864, Peoples R China
[5] Qingdao Acad Intelligent Ind, Qingdao 266114, Peoples R China
来源
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS | 2024年
基金
中国国家自然科学基金;
关键词
Defect detection; Federated learning; Manufacturing; Data models; Adaptation models; Training; Computational modeling; Community detection; contrastive learning; personalized federated learning (PFL); product surface defect detection; social manufacturing; FRAMEWORK;
D O I
10.1109/TCSS.2024.3405556
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Multiple organizations in social manufacturing can collaborate on high-quality product defect detection with social networks. Federated learning (FL) is an emerging paradigm where multiple clients can collaboratively train a defect detection model in a privacy-preserving manner. A prevalent issue in FL, concept drift, is discussed in this article. Feature representations of the same label may vary at different clients which affects the performance of FL. To address this issue, a novel community aware personalized federated learning (CA-PFL) is proposed in this article. A graph structured federation social network is constructed with local model updates. Communities in federation network are discovered with community detection to ensure that the same label at different clients have similar representations in each community. Shared layers of local models are aggregated in each community and each local client keeps their personalized layers. Furthermore, a federation community contrastive loss (FedCCL) is proposed to accelerate training convergence by constraining the direction of local model updating. Experimental results on nine datasets demonstrate that CA-PFL achieves higher accuracy and faster convergence than state-of- the-art personalized federated learning methods in concept drifts scenarios.
引用
收藏
页码:8064 / 8077
页数:14
相关论文
共 57 条
  • [1] Acar DAE, 2021, Arxiv, DOI arXiv:2111.04263
  • [2] MVTec AD - A Comprehensive Real-World Dataset for Unsupervised Anomaly Detection
    Bergmann, Paul
    Fauser, Michael
    Sattlegger, David
    Steger, Carsten
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9584 - 9592
  • [3] Fast unfolding of communities in large networks
    Blondel, Vincent D.
    Guillaume, Jean-Loup
    Lambiotte, Renaud
    Lefebvre, Etienne
    [J]. JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2008,
  • [4] Chen H.-Y., 2022, P INT C LEARN REPR, P1
  • [5] Chen T., 2020, BT P 37 INT C MACH L, P1597, DOI DOI 10.48550/ARXIV.2002.05709
  • [6] Exploring Simple Siamese Representation Learning
    Chen, Xinlei
    He, Kaiming
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15745 - 15753
  • [7] FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare
    Chen, Yiqiang
    Qin, Xin
    Wang, Jindong
    Yu, Chaohui
    Gao, Wen
    [J]. IEEE INTELLIGENT SYSTEMS, 2020, 35 (04) : 83 - 93
  • [8] Collins L, 2021, PR MACH LEARN RES, V139
  • [9] Fallah A., 2020, Advances in Neural Information Processing Systems, VVolume 33, P3557
  • [10] An Evolutionary Multiobjective Approach for Community Discovery in Dynamic Networks
    Folino, Francesco
    Pizzuti, Clara
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (08) : 1838 - 1852