Client selection based weighted federated few-shot learning

被引:7
|
作者
Xu, Xinlei [1 ,2 ]
Niu, Saisai [3 ,4 ]
Zhe, Wanga [1 ,2 ]
Li, Dongdong [2 ]
Yang, Hai [2 ]
Du, Wenli [1 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
[4] China Aerosp Sci & Technol Corp, Res & Dev Ctr Infrared Detect Technol, Shanghai 201109, Peoples R China
基金
美国国家科学基金会;
关键词
Federated learning; Few-shot learning; Meta learning; Image classification; SECURE;
D O I
10.1016/j.asoc.2022.109488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancement of technology, clients have a large amount of personal data. Human beings are paying more and more attention to the privacy and security of this part of data. Clients do not want to share private data, which directly leads to the existence of data islands. Especially in few-shot scenarios, due to the insufficient amount of personal data, constructing an effective few-shot model is difficult. To solve the above problems, we propose Federated Few-shot Learning (FedFSL) in this paper. We utilize Federated Learning (FedL) to ensure the privacy and security issues of joint training. Moreover, the global model obtained by FedL has the characteristics of universally applicable to all clients. That universality satisfies the scenario of universally applicable to all meta tasks in the fewshot meta-learning stage. What is more, to obtain a more effective global federated universal few-shot model, we respectively proposed Weighted FedL (WFedL) and Client Selection based FedL (CSFedL) strategies. WFedL takes into account the difference between clients performance when building the global model and assigns different weights to different clients. CSFedL considers the malicious participation of clients, and we propose an adaptive client selection strategy to mitigate the impact caused by malicious participation. Extensive federated experiments on CIFAR-10 and CIFAR-100 show the advantage of proposed WFedL, CSFedL and combined Client Selection based WFedL (CSWFedL). We further verify the performance improvement of FedFSL on miniImagenet and propose our overall framework Client Selection based WFedFSL (CSWFedFSL). The best performance of CSWFedFSL is higher than both the few-shot baseline and FedFSL, and CSWFedFSL protects clients data privacy in the few-shot scenario. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Federated Few-shot Learning
    Wang, Song
    Fu, Xingbo
    Ding, Kaize
    Chen, Chen
    Chen, Huiyuan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2374 - 2385
  • [2] Personalized Federated Few-Shot Learning
    Zhao, Yunfeng
    Yu, Guoxian
    Wang, Jun
    Domeniconi, Carlotta
    Guo, Maozu
    Zhang, Xiangliang
    Cui, Lizhen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 2534 - 2544
  • [3] Federated Few-Shot Learning with Adversarial Learning
    Fan, Chenyou
    Huang, Jianwei
    2021 19TH INTERNATIONAL SYMPOSIUM ON MODELING AND OPTIMIZATION IN MOBILE, AD HOC, AND WIRELESS NETWORKS (WIOPT), 2021,
  • [4] Few-Shot Model Agnostic Federated Learning
    Huang, Wenke
    Ye, Mang
    Du, Bo
    Gao, Xiang
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 7309 - 7316
  • [5] Lightweight Industrial Image Classifier Based on Federated Few-Shot Learning
    Sun, Xinyue
    Yang, Shusen
    Zhao, Cong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (06) : 7367 - 7376
  • [6] Federated Learning and Optimization for Few-Shot Image Classification
    Zuo, Yi
    Chen, Zhenping
    Feng, Jing
    Fan, Yunhao
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (03): : 4649 - 4667
  • [7] Few-Shot Federated Learning: A Federated Learning Model for Small-Sample Scenarios
    Tian, Junfeng
    Chen, Xinyao
    Wang, Shuo
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [8] Benchmarking Federated Few-Shot Learning for Video-Based Action Recognition
    Tu, Nguyen Anh
    Aikyn, Nartay
    Makhanov, Nursultan
    Abu, Assanali
    Wong, Kok-Seng
    Lee, Min-Ho
    IEEE Access, 2024, 12 : 193141 - 193164
  • [9] Federated few-shot learning for cough classification with edge devices
    Ngan Dao Hoang
    Dat Tran-Anh
    Manh Luong
    Cong Tran
    Cuong Pham
    APPLIED INTELLIGENCE, 2023, 53 (23) : 28241 - 28253
  • [10] Federated few-shot learning for cough classification with edge devices
    Ngan Dao Hoang
    Dat Tran-Anh
    Manh Luong
    Cong Tran
    Cuong Pham
    Applied Intelligence, 2023, 53 : 28241 - 28253