A Hierarchical Incentive Mechanism for Federated Learning

被引:6
作者
Huang, Jiwei [1 ]
Ma, Bowen [1 ]
Wu, Yuan [2 ,3 ]
Chen, Ying [4 ]
Shen, Xuemin [5 ]
机构
[1] China Univ Petr, Beijing Key Lab Petr Data Min, Beijing 102249, Peoples R China
[2] Univ Macau, State Key Lab Internet Things Smart City, Macau 999078, Peoples R China
[3] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
[4] Beijing Informat Sci & Technol Univ, Comp Sch, Beijing 100101, Peoples R China
[5] Univ Waterloo, Dept Elect & Comp Engn, Waterloo, ON N2L 3G1, Canada
基金
北京市自然科学基金;
关键词
Games; Contracts; Training; Data models; Task analysis; Computational modeling; Sensors; Incentive mechanism; federated learning; contract theory; Stackelberg game; RESOURCE-ALLOCATION; CONTRACT DESIGN; OPTIMIZATION; NETWORKS;
D O I
10.1109/TMC.2024.3423399
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the explosive development of mobile computing, federated learning (FL) has been considered as a promising distributed training framework for addressing the shortage of conventional cloud based centralized training. In FL, local model owners (LMOs) individually train their respective local models and then upload the trained local models to the task publisher (TP) for aggregation to obtain the global model. When the data provided by LMOs do not meet the requirements for model training, they can recruit workers to collect data. In this paper, by considering the interactions among the TP, LMOs and workers, we propose a three-layer hierarchical game framework. However, there are two challenges. First, information asymmetry between workers and LMOs may result in that the workers hide their types. Second, incentive mismatch between TP and LMOs may result in a lack of LMOs' willingness to participate in FL. Therefore, we decompose the hierarchical-based framework into two layers to address these challenges. For the lower-layer, we leverage the contract theory to ensure truthful reporting of the workers' types, based on which we simplify the feasible conditions of the contract and design the optimal contract. For the upper-layer, the Stackelberg game is adopted to model the interactions between the TP and LMOs, and we derive the Nash equilibrium and Stackelberg equilibrium solutions. Moreover, we develop an iterative Hierarchical-based Utility Maximization Algorithm (HUMA) to solve the coupling problem between upper-layer and lower-layer games. Extensive numerical experimental results verify the effectiveness of HUMA, and the comparison results illustrate the performance gain of HUMA.
引用
收藏
页码:12731 / 12747
页数:17
相关论文
共 44 条
[1]   Crowdsensing Data Trading based on Combinatorial Multi-Armed Bandit and Stackelberg Game [J].
An, Baoyi ;
Xiao, Mingjun ;
Liu, An ;
Xie, Xike ;
Zhou, Xiaofang .
2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, :253-264
[2]   Federated learning of predictive models from federated Electronic Health Records [J].
Brisimi, Theodora S. ;
Chen, Ruidi ;
Mela, Theofanie ;
Olshevsky, Alex ;
Paschalidis, Ioannis Ch. ;
Shi, Wei .
INTERNATIONAL JOURNAL OF MEDICAL INFORMATICS, 2018, 112 :59-67
[3]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[4]   QoE-Aware Decentralized Task Offloading and Resource Allocation for End-Edge-Cloud Systems: A Game-Theoretical Approach [J].
Chen, Ying ;
Zhao, Jie ;
Wu, Yuan ;
Huang, Jiwei ;
Shen, Xuemin .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (01) :769-784
[5]  
Cohen G, 2017, IEEE IJCNN, P2921, DOI 10.1109/IJCNN.2017.7966217
[6]   AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning [J].
Deng, Yongheng ;
Lyu, Feng ;
Ren, Ju ;
Wu, Huaqing ;
Zhou, Yuezhi ;
Zhang, Yaoxue ;
Shen, Xuemin .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (08) :1996-2009
[7]   Optimal Contract Design for Efficient Federated Learning With Multi-Dimensional Private Information [J].
Ding, Ningning ;
Fang, Zhixuan ;
Huang, Jianwei .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (01) :186-200
[8]  
Gaff BM, 2014, COMPUTER, V47, P7
[9]  
Hariansah S, 2023, Novateur Publications, V1, P453
[10]   Blockchain and Federated Edge Learning for Privacy-Preserving Mobile Crowdsensing [J].
Hu, Qin ;
Wang, Zhilin ;
Xu, Minghui ;
Cheng, Xiuzhen .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (14) :12000-12011