Exploitation Maximization of Unlabeled Data for Federated Semi-Supervised Learning

被引:1
作者
Chen, Siguang [1 ]
Shen, Jianhua [1 ]
机构
[1] Nanjing Univ Posts & Telecommun, Sch Internet Things, Nanjing 210003, Peoples R China
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2025年 / 9卷 / 02期
基金
中国国家自然科学基金;
关键词
Federated learning; non-IID; semi-supervised learning; edge intelligence;
D O I
10.1109/TETCI.2024.3361866
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning (FL), as an emerging paradigm in edge intelligence, enables numerous edge devices to collaborate with a central server in training a shared model without compromising data privacy. Existing FL algorithms mostly focus on addressing the problem of non-independently and identically distributed (Non-IID) data in supervised scenarios. However, in practical settings, a considerable amount of unlabeled data exists, posing an urgent challenge of how to fully utilize such data. In this paper, we propose an exploitation maximization method of unlabeled data for federated semi-supervised learning (FSSL). Specifically, we adjust the optimization objective of high-confidence samples by considering both the predicted results and the class distribution of pseudo-labels. This adjustment enables the resolution of severe class imbalance issues. Additionally, we propose a diversity sampling strategy for low-confidence samples. The strategy aims to increase the diversity of training samples by sampling samples that are less similar to high-confidence samples, thereby improving the generalization ability of the model. Extensive experiments demonstrate that our method not only outperforms other state-of-the-art FSSL methods in non-IID scenarios but also exhibits superior scalability and robustness.
引用
收藏
页码:2039 / 2044
页数:6
相关论文
共 27 条
[1]  
Cao KD, 2019, ADV NEUR IN, V32
[2]  
Cascante-Bonilla P, 2021, AAAI CONF ARTIF INTE, V35, P6912
[3]   FedTriNet: A Pseudo Labeling Method with Three Players for Federated Semi-supervised Learning [J].
Che, Liwei ;
Long, Zewei ;
Wang, Jiaqi ;
Wang, Yaqing ;
Xiao, Houping ;
Ma, Fenglong .
2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2021, :715-724
[4]   Metadata and Image Features Co-Aware Semi-Supervised Vertical Federated Learning With Attention Mechanism [J].
Chen, Siguang ;
Jin, Tong ;
Xia, Yanyan ;
Li, Xue .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) :2520-2532
[5]  
Cho YJ, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P2881
[6]  
Guo Q., 2022, ARXIV
[7]   Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training With Non-IID Private Data [J].
Itahara, Sohei ;
Nishio, Takayuki ;
Koda, Yusuke ;
Morikura, Masahiro ;
Yamamoto, Koji .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (01) :191-205
[8]  
Jeong W., 2020, ARXIV200612097
[9]   Dynamic Bank Learning for Semi-supervised Federated Image Diagnosis with Class Imbalance [J].
Jiang, Meirui ;
Yang, Hongzheng ;
Li, Xiaoxiao ;
Liu, Quande ;
Heng, Pheng-Ann ;
Dou, Qi .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT III, 2022, 13433 :196-206
[10]   Metadata and Image Features Co-Aware Personalized Federated Learning for Smart Healthcare [J].
Jin, Tong ;
Pan, Shujia ;
Li, Xue ;
Chen, Siguang .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (08) :4110-4119