Robust Federated Learning With Noisy Labeled Data Through Loss Function Correction

被引:1
|
作者
Chen, Li [1 ]
Ang, Fan [1 ]
Chen, Yunfei [2 ]
Wang, Weidong [1 ]
机构
[1] Univ Sci & Technol China, Dept Elect Engn & Informat Sci, Hefei 230027, Anhui, Peoples R China
[2] Univ Warwick, Sch Engn, Coventry CV4 7AL, England
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 03期
基金
中国国家自然科学基金;
关键词
Noise measurement; Training; Servers; Data models; Federated learning; Loss measurement; Convergence; Distributed networks; federated learning; label noise; machine learning; non-convex optimization; parallel and distributed algorithms; robust design;
D O I
10.1109/TNSE.2022.3227287
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Federated learning (FL) is a communication efficient machine learning paradigm to leverage distributed data at the network edge. Nevertheless, FL usually fails to train a high-quality model from the networks, where the edge nodes collect noisy labeled data. To tackle this challenge, this paper focuses on developing an innovative robust FL. We consider two kinds of networks with different data distribution. Firstly, we design a reweighted FL under a full-data network, where all edge nodes are equipped with both numerous noisy labeled dataset and small clean dataset. The key idea is that edge devices learn to assign the local weights of loss functions in noisy labeled dataset, and cooperate with central server to update global weights. Secondly, we consider a part-data network where some edge nodes exclude clean dataset, and can not compute the weights locally. The broadcasting of the global weights is added to help those edge nodes without clean dataset to reweight their noisy loss functions. Both designs have a convergence rate of O(1=T-2). Simulation results illustrate that the both proposed training processes improve the prediction accuracy due to the proper weights assignments of noisy loss function.
引用
收藏
页码:1501 / 1511
页数:11
相关论文
共 50 条
  • [41] Robust Heterogeneous Federated Learning via Data-Free Knowledge Amalgamation
    Ma, Jun
    Fan, Zheng
    Fan, Chaoyu
    Kang, Qi
    ADVANCES IN SWARM INTELLIGENCE, PT II, ICSI 2024, 2024, 14789 : 61 - 71
  • [42] Advancing DoA assessment through federated learning: A one-shot pseudo data approach
    Schmierer, Thomas
    Li, Tianning
    Wu, Di
    Li, Yan
    NEUROCOMPUTING, 2025, 634
  • [43] Learning statistical models of phenotypes using noisy labeled training data
    Agarwal, Vibhu
    Podchiyska, Tanya
    Banda, Juan M.
    Goel, Veena
    Leung, Tiffany I.
    Minty, Evan P.
    Sweeney, Timothy E.
    Gyang, Elsie
    Shah, Nigam H.
    JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2016, 23 (06) : 1166 - 1173
  • [44] Improving Synthetic Data Generation Through Federated Learning in Scarce and Heterogeneous Data Scenarios
    Apellaniz, Patricia A.
    Parras, Juan
    Zazo, Santiago
    BIG DATA AND COGNITIVE COMPUTING, 2025, 9 (02)
  • [45] Robust Learning-Enabled Intelligence for the Internet of Things: A Survey From the Perspectives of Noisy Data and Adversarial Examples
    Wu, Yulei
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (12): : 9568 - 9579
  • [46] Towards Robust Federated Learning via Logits Calibration on Non-IID Data
    Qiao, Yu
    Adhikary, Apurba
    Zhang, Chaoning
    Hong, Choong Seon
    PROCEEDINGS OF 2024 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, NOMS 2024, 2024,
  • [47] CGFL: A Robust Federated Learning Approach for Intrusion Detection Systems Based on Data Generation
    Feng, Shu
    Gao, Luhan
    Shi, Leyi
    APPLIED SCIENCES-BASEL, 2025, 15 (05):
  • [48] FedAegis: Edge-Based Byzantine-Robust Federated Learning for Heterogeneous Data
    Zhou, Fangtong
    Yu, Ruozhou
    Li, Zhouyu
    Gu, Huayue
    Wang, Xiaojian
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 3005 - 3010
  • [49] Secure Data Sharing in Federated Learning through Blockchain-Based Aggregation
    Liu, Bowen
    Tang, Qiang
    FUTURE INTERNET, 2024, 16 (04)
  • [50] Robust Federated Learning for Ubiquitous Computing through Mitigation of Edge-Case Backdoor Attacks
    Elhattab, Fatima
    Bouchenak, Sara
    Talbi, Rania
    Nitu, Vlad
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (04):