Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 03期
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [31] A Client Selection Method Based on Loss Function Optimization for Federated Learning
    Zeng, Yan
    Teng, Siyuan
    Xiang, Tian
    Zhang, Jilin
    Mu, Yuankai
    Ren, Yongjian
    Wan, Jian
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137 (01): : 1047 - 1064
  • [32] Robust Federated Learning Based on Metrics Learning and Unsupervised Clustering for Malicious Data Detection
    Li, Jiaming
    Zhang, Xinyue
    Zhao, Liang
    ACMSE 2022: PROCEEDINGS OF THE 2022 ACM SOUTHEAST CONFERENCE, 2022, : 238 - 242
  • [33] Fed-DR-Filter: Using global data representation to reduce the impact of noisy labels on the performance of federated learning
    Duan, Shaoming
    Liu, Chuanyi
    Cao, Zhengsheng
    Jin, Xiaopeng
    Han, Peiyi
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 137 : 336 - 348
  • [34] LCFIL: A Loss Compensation Mechanism for Latest Data in Federated Incremental Learning
    Cao, Bokai
    Wu, Weigang
    Zhou, Jieying
    2022 IEEE 19TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2022), 2022, : 332 - 338
  • [35] Learning from Noisy Complementary Labels with Robust Loss Functions
    Ishiguro, Hiroki
    Ishida, Takashi
    Sugiyama, Masashi
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2022, E105D (02) : 364 - 376
  • [36] FedINC: An Exemplar-Free Continual Federated Learning Framework with Small Labeled Data
    Deng, Yongheng
    Yue, Sheng
    Wang, Tuowei
    Wang, Guanbo
    Ren, Ju
    Zhang, Yaoxue
    PROCEEDINGS OF THE 21ST ACM CONFERENCE ON EMBEDDED NETWORKED SENSOR SYSTEMS, SENSYS 2023, 2023, : 56 - 69
  • [37] Robust Learning From Noisy Web Images Via Data Purification for Fine-Grained Recognition
    Zhang, Chuanyi
    Wang, Qiong
    Xie, Guosen
    Wu, Qi
    Shen, Fumin
    Tang, Zhenmin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1198 - 1209
  • [38] Byzantine-robust Federated Learning through Collaborative Malicious Gradient Filtering
    Xu, Jian
    Huang, Shao-Lun
    Song, Linqi
    Lan, Tian
    2022 IEEE 42ND INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2022), 2022, : 1223 - 1235
  • [39] Byzantine-robust federated learning over Non-IID data
    Ma X.
    Li Q.
    Jiang Q.
    Ma Z.
    Gao S.
    Tian Y.
    Ma J.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (06): : 138 - 153
  • [40] Research on Data Heterogeneous Robust Federated Learning with Privacy Protection in Internet of Things
    Yang Z.
    Wang Z.
    Wu D.
    Wang R.
    Wu Y.
    Lü Y.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2023, 45 (12): : 4235 - 4244