A federated learning method based on class prototype guided classifier for long-tailed data

被引:0
作者
Li, Yang [1 ]
Liu, Xin [1 ]
Li, Kan [1 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci & Technol, 5 Zhongguancun South St, Beijing 100081, Peoples R China
基金
北京市自然科学基金;
关键词
Federated learning; Long-tailed data; Class prototypes; Deep learning;
D O I
10.1007/s11760-024-03525-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In federated learning, training on long-tailed data frequently leads to biased classifiers due to a significant imbalance in the number of samples between majority and minority classes. Prototype-based methods have been proven effective in capturing underlying representations in federated learning, contributing to performance improvements by recent studies. However, the class prototypes can be influenced by sample size, class size, and the number of iterations. In this work, we propose a prototype-based federated learning method for long-tailed data by retraining classifiers. This involves freezing the global prototypes aggregated from local prototypes and using them as a regularization term to guide local training. Compared to previous prototype-based methods, our approach focuses on the expression differences of class prototypes in long-tailed data, reduces the classifier's reliance on the majority class samples, and can concentrate more on minority classes. Notably, our method does not introduce extra parameters and communication costs. We conduct experiments on image classification tasks under various settings, and our method outperforms all baselines in terms of performance.
引用
收藏
页码:8999 / 9007
页数:9
相关论文
共 50 条
[41]   Long-tailed visual classification based on supervised contrastive learning with multi-view fusion [J].
Zeng, Liang ;
Feng, Zheng ;
Chen, Jia ;
Wang, Shanshan .
KNOWLEDGE-BASED SYSTEMS, 2024, 301
[42]   Federated contrastive prototype learning: An efficient collaborative fault diagnosis method with data privacy [J].
Wang, Rui ;
Huang, Weiguo ;
Zhang, Xiao ;
Wang, Jun ;
Ding, Chuancang ;
Shen, Changqing .
KNOWLEDGE-BASED SYSTEMS, 2023, 281
[43]   Intermediate features matter in prototype-guided personalized federated learning [J].
Zhang, Peifeng ;
Chen, Jiahui ;
Xiang, Chunxiang ;
Huang, Huiwu ;
Jiang, Huaien ;
Yang, Kaixiang .
INFORMATION FUSION, 2025, 124
[44]   Long-Tailed Recognition Based on Self-attention Mechanism [J].
Feng, Zekai ;
Jia, Hong ;
Li, Mengke .
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14876 :380-391
[45]   Prototype-based fine-tuning for mitigating data heterogeneity in federated learning [J].
Chai, Liming ;
Xie, Jun ;
Zhou, Nanrun .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2025, 170
[46]   NCL plus plus : Nested Collaborative Learning for long-tailed visual recognition [J].
Tan, Zichang ;
Li, Jun ;
Du, Jinhao ;
Wan, Jun ;
Lei, Zhen ;
Guo, Guodong .
PATTERN RECOGNITION, 2024, 147
[47]   Progressively Balanced Supervised Contrastive Representation Learning for Long-Tailed Fault Diagnosis [J].
Peng, Peng ;
Lu, Jiaxun ;
Tao, Shuting ;
Ma, Ke ;
Zhang, Yi ;
Wang, Hongwei ;
Zhang, Heming .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[48]   Heterogeneous Defect Prediction Based on Federated Prototype Learning [J].
Wang, Aili ;
Yang, Linlin ;
Wu, Haibin ;
Iwahori, Yuji .
IEEE ACCESS, 2023, 11 :98618-98632
[49]   Secure Data sharing method based on Federated Learning in IoVs [J].
Fan, Shu-Jia ;
Xue, Jia-Wen .
ICC 2024 - IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, 2024, :1328-1333
[50]   Grid False Data Intrusion Detection Method Based on Edge Computing and Federated Learning [J].
Zhang, Yiying ;
Liu, Yiyang ;
Zhang, Nan ;
Wang, Delong ;
Zhang, Suxiang ;
Wu, Yannian .
3D IMAGING-MULTIDIMENSIONAL SIGNAL PROCESSING AND DEEP LEARNING, VOL 1, 2022, 297 :179-188