A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
[21]   Long-tailed classification based on dynamic class average loss [J].
Lee, Do Ryun ;
Kim, Chang Ouk .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 288
[22]   A client-level dynamic federated learning reweighting strategy for long-tailed classification [J].
Li, Yang ;
Zhang, Ji ;
Zhang, Lin ;
Li, Kan .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 293
[23]   Deep Long-Tailed Learning: A Survey [J].
Zhang, Yifan ;
Kang, Bingyi ;
Hooi, Bryan ;
Yan, Shuicheng ;
Feng, Jiashi .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) :10795-10816
[24]   Survey on Deep Long-tailed Learning [J].
Han, Jia-Yi ;
Liu, Jian-Wei ;
Chen, De-Hua ;
Xu, Jing-Dong ;
Dai, Qi ;
Xia, Peng-Fei .
Zidonghua Xuebao/Acta Automatica Sinica, 2025, 51 (05) :985-1020
[25]   Federated learning on non-IID and globally long-tailed data via meta re-weighting networks [J].
Lu, Yang ;
Qian, Pinxin ;
Yan, Shanshan ;
Huang, Gang ;
Tang, Yuan Yan .
INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2024, 22 (03)
[26]   A Novel Long-Tailed Aerial Target Classification Method Based on Adaptive Decoupled Learning [J].
Zheng, Muhai ;
Li, Shuai ;
Tian, Biao ;
Xu, Shiyou .
2024 IEEE 8TH INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING, ICVISP, 2024,
[27]   PILoRA: Prototype Guided Incremental LoRA for Federated Class-Incremental Learning [J].
Guo, Haiyang ;
Zhu, Fei ;
Liu, Wenzhuo ;
Zhang, Xu-Yao ;
Liu, Cheng-Lin .
COMPUTER VISION - ECCV 2024, PT LXV, 2025, 15123 :141-159
[28]   LTNI-FGML: Federated Graph Machine Learning on Long-Tailed and Non-IID Data via Logit Calibration [J].
Yan, Dongqi ;
Wang, Jinyan ;
Huang, Qingyi ;
Huang, Juanjuan ;
Li, Xianxian .
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV, 2023, 14257 :486-498
[29]   Easy balanced mixing for long-tailed data [J].
Zhu, Zonghai ;
Xing, Huanlai ;
Xu, Yuge .
KNOWLEDGE-BASED SYSTEMS, 2022, 248
[30]   An Intelligent Grading Model for Myopic Maculopathy Based on Long-Tailed Learning [J].
Zheng, Bo ;
Wang, Chen ;
Zhang, Maotao ;
Zhu, Shaojun ;
Wu, Maonian ;
Wu, Tao ;
Yang, Weihua ;
Chen, Lu .
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2025, 14 (03)