A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
[1]   Federated ensemble learning on long-tailed data with prototypes [J].
Li, Yang ;
Liu, Xin ;
Li, Kan .
INTELLIGENT DATA ANALYSIS, 2025,
[2]   Federated Long-Tailed Learning by Retraining the Biased Classifier with Prototypes [J].
Li, Yang ;
Li, Kan .
FRONTIERS IN CYBER SECURITY, FCS 2023, 2024, 1992 :575-585
[3]   Federated Learning for Assigning Weights to Clients on Long-Tailed Data [J].
Li, Yang ;
Li, Kan .
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 :438-449
[4]   Federated Learning With Long-Tailed Data via Representation Unification and Classifier Rectification [J].
Huang, Wenke ;
Liu, Yuxia ;
Ye, Mang ;
Chen, Jun ;
Du, Bo .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 :5738-5750
[5]   Dynamic Adaptive Federated Learning on Local Long-Tailed Data [J].
Pu, Juncheng ;
Fu, Xiaodong ;
Dong, Hai ;
Zhang, Pengcheng ;
Liu, Li .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2024, 17 (06) :3485-3498
[6]   Federated deep long-tailed learning: A survey [J].
Li, Kan ;
Li, Yang ;
Zhang, Ji ;
Liu, Xin ;
Ma, Zhichao .
NEUROCOMPUTING, 2024, 595
[7]   A Survey on Federated Long-Tailed Learning [J].
Zhou, Yi-Zhi ;
Wang, Jun-Xiao ;
Xie, Xin ;
Wang, Peng-Fei ;
Jia, Xi-Bei ;
Qi, Heng ;
Qin, Yu-Chen .
Jisuanji Xuebao/Chinese Journal of Computers, 2025, 48 (04) :779-807
[8]   Improving Generalization and Personalization in Long-Tailed Federated Learning via Classifier Retraining [J].
Li, Yuhang ;
Liu, Tong ;
Shen, Wenfeng ;
Cui, Yangguang ;
Lu, Weijia .
EURO-PAR 2024: PARALLEL PROCESSING, PART II, EURO-PAR 2024, 2024, 14802 :408-423
[9]   FedCRAC: Improving Federated Classification Performance on Long-Tailed Data via Classifier Representation Adjustment and Calibration [J].
Li, Xujing ;
Sun, Sheng ;
Liu, Min ;
Ren, Ju ;
Jiang, Xuefeng ;
He, Tianliu .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2025, 24 (01) :482-499
[10]   Scoring Aided Federated Learning on Long-Tailed Data for Wireless IoMT Based Healthcare System [J].
Zhang, Lianhong ;
Wu, Yuxin ;
Chen, Lunyuan ;
Fan, Lisheng ;
Nallanathan, Arumugam .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (06) :3341-3348