Client selection based weighted federated few-shot learning

被引:7
|
作者
Xu, Xinlei [1 ,2 ]
Niu, Saisai [3 ,4 ]
Zhe, Wanga [1 ,2 ]
Li, Dongdong [2 ]
Yang, Hai [2 ]
Du, Wenli [1 ]
机构
[1] East China Univ Sci & Technol, Key Lab Smart Mfg Energy Chem Proc, Minist Educ, Shanghai 200237, Peoples R China
[2] East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China
[3] Shanghai Aerosp Control Technol Inst, Shanghai 201109, Peoples R China
[4] China Aerosp Sci & Technol Corp, Res & Dev Ctr Infrared Detect Technol, Shanghai 201109, Peoples R China
基金
美国国家科学基金会;
关键词
Federated learning; Few-shot learning; Meta learning; Image classification; SECURE;
D O I
10.1016/j.asoc.2022.109488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the advancement of technology, clients have a large amount of personal data. Human beings are paying more and more attention to the privacy and security of this part of data. Clients do not want to share private data, which directly leads to the existence of data islands. Especially in few-shot scenarios, due to the insufficient amount of personal data, constructing an effective few-shot model is difficult. To solve the above problems, we propose Federated Few-shot Learning (FedFSL) in this paper. We utilize Federated Learning (FedL) to ensure the privacy and security issues of joint training. Moreover, the global model obtained by FedL has the characteristics of universally applicable to all clients. That universality satisfies the scenario of universally applicable to all meta tasks in the fewshot meta-learning stage. What is more, to obtain a more effective global federated universal few-shot model, we respectively proposed Weighted FedL (WFedL) and Client Selection based FedL (CSFedL) strategies. WFedL takes into account the difference between clients performance when building the global model and assigns different weights to different clients. CSFedL considers the malicious participation of clients, and we propose an adaptive client selection strategy to mitigate the impact caused by malicious participation. Extensive federated experiments on CIFAR-10 and CIFAR-100 show the advantage of proposed WFedL, CSFedL and combined Client Selection based WFedL (CSWFedL). We further verify the performance improvement of FedFSL on miniImagenet and propose our overall framework Client Selection based WFedFSL (CSWFedFSL). The best performance of CSWFedFSL is higher than both the few-shot baseline and FedFSL, and CSWFedFSL protects clients data privacy in the few-shot scenario. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Personalized federated few-shot node classification
    Yunfeng ZHAO
    Xintong HE
    Guoxian YU
    Jun WANG
    Yongqing ZHENG
    Carlotta DOMENICONI
    Science China(Information Sciences), 2025, 68 (01) : 204 - 218
  • [22] Universal Steganalysis Based on Few-shot Learning
    Li D.-Q.
    Fu Z.-J.
    Cheng X.
    Song C.
    Sun X.-M.
    Ruan Jian Xue Bao/Journal of Software, 2022, 33 (10): : 3874 - 3890
  • [23] Few-shot learning based on deep learning: A survey
    Zeng, Wu
    Xiao, Zheng-ying
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2024, 21 (01) : 679 - 711
  • [24] Iris recognition based on few-shot learning
    Lei, Songze
    Dong, Baihua
    Li, Yonggang
    Xiao, Feng
    Tian, Feng
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2021, 32 (3-4)
  • [25] Entailment Method Based on Template Selection for Chinese Text Few-shot Learning
    Wang, Zeyuan
    Wei, Zhiyu
    Zhang, Lihui
    Li, Ruifan
    Ma, Zhangyu
    2021 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2021, : 2060 - 2065
  • [26] Federated Few-Shot Learning-Based Machinery Fault Diagnosis in the Industrial Internet of Things
    Liang, Yingying
    Zhao, Peng
    Wang, Yimeng
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [27] Learning Feature Exploration and Selection With Handcrafted Features for Few-Shot Learning
    Zhang, Yi
    Huang, Sheng
    Huangfu, Luwen
    Zeng, Daniel Dajun
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2025,
  • [28] A Few-Shot Learning Method for SAR Images Based on Weighted Distance and Feature Fusion
    Gao, Fei
    Xu, Jingming
    Lang, Rongling
    Wang, Jun
    Hussain, Amir
    Zhou, Huiyu
    REMOTE SENSING, 2022, 14 (18)
  • [29] Defensive Few-Shot Learning
    Li, Wenbin
    Wang, Lei
    Zhang, Xingxing
    Qi, Lei
    Huo, Jing
    Gao, Yang
    Luo, Jiebo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5649 - 5667
  • [30] Fractal Few-Shot Learning
    Zhou, Fobao
    Huang, Wenkai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 15