An Uncertainty-Aware Auction Mechanism for Federated Learning

被引:0
作者
Xu, Jiali [1 ]
Tang, Bin [2 ]
Cui, Hengrui [3 ]
Ye, Baoliu [3 ]
机构
[1] Nanjing Univ, Software Inst, Nanjing 210093, Peoples R China
[2] Hohai Univ, Sch Comp & Informat, Nanjing 211100, Peoples R China
[3] Nanjing Univ, Natl Key Lab Novel Software Technol, Nanjing 211100, Peoples R China
来源
ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2023, PT VI | 2024年 / 14492卷
基金
中国国家自然科学基金;
关键词
Federated learning; Incentive mechanism; Reverse auction; INCENTIVE MECHANISM; NETWORKS; TIME;
D O I
10.1007/978-981-97-0811-6_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning enables multiple data owners to collaboratively train a shared machine learning model without the need to disclose their local training data. However, it is not practical for all clients to unconditionally contribute their resources; thus, designing an incentive mechanism in federated learning becomes an important issue. Some existing studies adopt the framework of reverse auctions for incentive design, but they do not take the uncertainty of the training time of clients into account. Consequently, a situation may arise where a client is unable to meet the training deadline, and the server cannot wait indefinitely. In this paper, we propose a reverse auction framework that takes the uncertainty of training time into account. We formulate an expected social welfare maximization problem and prove its NP-hardness. We then introduce an efficient dynamic programming-based algorithm which can find an optimal solution in pseudo-polynomial time. Building upon this, we propose a truthful auction mechanism based on the well-known Vickrey-Clarke-Groves (VCG) mechanism. Furthermore, to reduce the time complexity, we introduce an additional truthful auction mechanism based on a greedy algorithm which achieves a near-optimal performance in polynomial time. Finally, the effectiveness of the proposed two auction mechanisms is verified through simulation experiments.
引用
收藏
页码:1 / 18
页数:18
相关论文
共 27 条
[1]  
Ahmed Kishwar, 2020, SIGSIM-PADS '20: Proceedings of the 2020 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, P99, DOI 10.1145/3384441.3395991
[2]  
Bonawitz K., 2019, SysML 2019, P1, DOI DOI 10.48550/ARXIV.1902.01046
[3]   Machine learning and the physical sciences [J].
Carleo, Giuseppe ;
Cirac, Ignacio ;
Cranmer, Kyle ;
Daudet, Laurent ;
Schuld, Maria ;
Tishby, Naftali ;
Vogt-Maranto, Leslie ;
Zdeborova, Lenka .
REVIEWS OF MODERN PHYSICS, 2019, 91 (04)
[4]   Analysis of dawnbench, a time-to-accuracy machine learning performance benchmark [J].
Coleman C. ;
Kang D. ;
Narayanan D. ;
Nardi L. ;
Zhao T. ;
Zhang J. ;
Bailis P. ;
Olukotun K. ;
Ré C. ;
Zaharia M. .
Operating Systems Review (ACM), 2019, 53 (01) :14-25
[5]   FAIR: Quality-Aware Federated Learning with Precise User Incentive and Model Aggregation [J].
Deng, Yongheng ;
Lyu, Feng ;
Ren, Ju ;
Chen, Yi-Chao ;
Yang, Peng ;
Zhou, Yuezhi ;
Zhang, Yaoxue .
IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,
[6]   Minimizing Training Time of Distributed Machine Learning by Reducing Data Communication [J].
Duan, Yubin ;
Wang, Ning ;
Wu, Jie .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (02) :1802-1814
[7]   Valuation Compressions in VCG-Based Combinatorial Auctions [J].
Dutting, Paul ;
Henzinger, Monika ;
Starnberger, Martin .
ACM TRANSACTIONS ON ECONOMICS AND COMPUTATION, 2018, 6 (02)
[8]   An Efficient Framework for Clustered Federated Learning [J].
Ghosh, Avishek ;
Chung, Jichan ;
Yin, Dong ;
Ramchandran, Kannan .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (12) :8076-8091
[9]   Decentralized Transaction Mechanism Based on Smart Contract in Distributed Data Storage [J].
Gu, Yonggen ;
Hou, Dingding ;
Wu, Xiaohong ;
Tao, Jie ;
Zhang, Yanqiong .
INFORMATION, 2018, 9 (11)
[10]   Trading Data For Learning: Incentive Mechanism For On-Device Federated Learning [J].
Hu, Rui ;
Gong, Yanmin .
2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,