Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 03期
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [21] Overcoming Noisy Labels in Federated Learning Through Local Self-Guiding
    Bai, Daokuan
    Wang, Shanshan
    Wang, Wenyue
    Wang, Hua
    Zhao, Chuan
    Yuan, Peng
    Chen, Zhenxiang
    2023 IEEE/ACM 23RD INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING, CCGRID, 2023, : 367 - 376
  • [22] Byzantine-Robust Federated Learning through Dynamic Clustering
    Wang, Hanyu
    Wang, Liming
    Li, Hongjia
    2023 IEEE 22ND INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS, TRUSTCOM, BIGDATASE, CSE, EUC, ISCI 2023, 2024, : 222 - 230
  • [23] Robust Incentive Mechanism of Federated Learning for Data Quality Uncertainty
    Wang, Chao
    Li, Bingze
    Yang, Yang
    INFORMATION TECHNOLOGY AND CONTROL, 2024, 53 (04): : 1139 - 1151
  • [24] Encrypted Data Caching and Learning Framework for Robust Federated Learning-Based Mobile Edge Computing
    Nguyen, Chi-Hieu
    Saputra, Yuris Mulya
    Hoang, Dinh Thai
    Nguyen, Diep N.
    Nguyen, Van-Dinh
    Xiao, Yong
    Dutkiewicz, Eryk
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (03) : 2705 - 2720
  • [25] Tackling Data Heterogeneity in Federated Learning via Loss Decomposition
    Zeng, Shuang
    Guo, Pengxin
    Wang, Shuai
    Wang, Jianbo
    Zhou, Yuyin
    Qu, Liangqiong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT X, 2024, 15010 : 707 - 717
  • [26] Making federated learning robust to adversarial attacks by learning data and model association
    Qayyum, Adnan
    Janjua, Muhammad Umar
    Qadir, Junaid
    COMPUTERS & SECURITY, 2022, 121
  • [27] FLForest: Byzantine-robust Federated Learning through Isolated Forest
    Wang, Tao
    Zhao, Bo
    Fang, Liming
    2022 IEEE 28TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, ICPADS, 2022, : 296 - 303
  • [28] Auto-weighted Robust Federated Learning with Corrupted Data Sources
    Li, Shenghui
    Ngai, Edith
    Ye, Fanghua
    Voigt, Thiemo
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [29] Application of Robust Zero-Watermarking Scheme Based on Federated Learning for Securing the Healthcare Data
    Han, Baoru
    Jhaveri, Rutvij H.
    Wang, Han
    Qiao, Dawei
    Du, Jinglong
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (02) : 804 - 813
  • [30] FedCom: Byzantine-Robust Federated Learning Using Data Commitment
    Zhao, Bo
    Wang, Tao
    Fang, Liming
    ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2023, : 33 - 38