Data Valuation Methods for Federated Learning

被引:0
作者
Ardic, Emre [1 ]
Genc, Yakup [1 ]
机构
[1] Gebze Tekn Univ, Bilgisayar Muhendisligi Bolumu, Kocaeli, Turkiye
来源
2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU | 2023年
关键词
Federated Learning (FL); Data Valuation; Convolutional Neural Networks (CNN);
D O I
10.1109/SIU59756.2023.10223784
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modern distributed networks such as smartphones, wearable devices, and self-driving vehicles generate a wealth of data. As the computation, storage, and battery capabilities of these devices grow, local data storage and processing become easier and more secure. This has led to a growing interest in federated learning which provides training of deep learning models while keeping the training data decentralized. During the training, the performance of deep learning models can be improved by filtering redundant, malicious, and abnormal samples with data valuation methods. In this work, the aim is to improve federated learning models by integrating data valuation methods into the training process. For this, a two-layered convolutional neural network is trained on the MNIST dataset inside a small federated learning network. The Shapley and Leave-one-out based data evaluation methods developed in this study have resulted in an 8.81% accuracy improvement during experiments conducted on the MNIST dataset with corrupted labels.
引用
收藏
页数:4
相关论文
共 15 条
[1]  
Aledhari M, 2020, IEEE ACCESS, V8, P140699, DOI [10.1109/ACCESS.2020.3013541, 10.1109/access.2020.3013541]
[2]  
McMahan HB, 2018, Arxiv, DOI arXiv:1710.06963
[3]  
Ghorbani A, 2019, PR MACH LEARN RES, V97
[4]  
He CY, 2020, Arxiv, DOI arXiv:2007.13518
[5]  
Katharopoulos A, 2018, PR MACH LEARN RES, V80
[6]  
Shyn SK, 2021, Arxiv, DOI arXiv:2106.02310
[7]   Sample-level Data Selection for Federated Learning [J].
Li, Anran ;
Zhang, Lan ;
Tan, Juntao ;
Qin, Yaxuan ;
Wang, Junhao ;
Li, Xiang-Yang .
IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
[8]   TODQA: Efficient Task-Oriented Data Quality Assessment [J].
Li, Anran ;
Zhang, Lan ;
Qian, Jianwen ;
Xiao, Xiang ;
Li, Xiang-Yang ;
Xie, Yunting .
2019 15TH INTERNATIONAL CONFERENCE ON MOBILE AD-HOC AND SENSOR NETWORKS (MSN 2019), 2019, :81-88
[9]   Federated Learning: Challenges, Methods, and Future Directions [J].
Li, Tian ;
Sahu, Anit Kumar ;
Talwalkar, Ameet ;
Smith, Virginia .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (03) :50-60
[10]   Record and Reward Federated Learning Contributions with Blockchain [J].
Martinez, Ismael ;
Francis, Sreya ;
Hafid, Abdelhakim Senhaji .
2019 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC), 2019, :50-57