Incentivizing Federated Learning Under Long-Term Energy Constraint via Online Randomized Auctions

被引:19
作者
Yuan, Yulan [1 ]
Jiao, Lei [2 ]
Zhu, Konglin [1 ,3 ]
Zhang, Lin [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] Univ Oregon, Dept Comp & Informat Sci, Eugene, OR 97403 USA
[3] Purple Mt Labs, Nanjing 210023, Peoples R China
基金
美国国家科学基金会;
关键词
Collaborative work; Computational modeling; Data models; Costs; Mobile handsets; Biological system modeling; Wireless communication; Federated learning; energy constraint; incentive mechanism; OPTIMIZATION APPROACH; NETWORKS; CONVERGENCE; MECHANISM; PRIVACY; DESIGN;
D O I
10.1109/TWC.2021.3137024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mobile users are often reluctant to participate in federated learning to train models, due to the excessive consumption of the limited resources such as the mobile devices' energy. We propose an auction-based online incentive mechanism, FLORA, which allows users to submit bids dynamically and repetitively and compensates such bids subject to each user's long-term battery capacity. We formulate a nonlinear mixed-integer program to capture the social cost minimization in the federated learning system. Then we design multiple polynomial-time online algorithms, including a fractional online algorithm and a randomized rounding algorithm to select winning bids and control training accuracy, as well as a payment allocation algorithm to calculate the remuneration based on the bid-winning probabilities. Maintaining the satisfiable quality of the global model that is trained, our approach works on the fly without relying on the unknown future inputs, and achieves provably a sublinear regret and a sublinear fit over time while attaining the economic properties of truthfulness and individual rationality in expectation. Extensive trace-driven evaluations have confirmed the practical superiority of FLORA over existing alternatives.
引用
收藏
页码:5129 / 5144
页数:16
相关论文
共 45 条
[1]  
Archer A, 2001, ANN IEEE SYMP FOUND, P482
[2]  
Carr RD, 2000, PROCEEDINGS OF THE ELEVENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P106
[3]  
casadi, BUILD EFFICIENT OPTI
[4]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[5]   CloudHeat: An Efficient Online Market Mechanism for Datacenter Heat Harvesting [J].
Chen, Shutong ;
Zhou, Zhi ;
Liu, Fangming ;
Li, Zongpeng ;
Ren, Shaolei .
ACM TRANSACTIONS ON MODELING AND PERFORMANCE EVALUATION OF COMPUTING SYSTEMS, 2018, 3 (03)
[6]   Heterogeneous Online Learning for "Thing-Adaptive" Fog Computing in IoT [J].
Chen, Tianyi ;
Ling, Qing ;
Shen, Yanning ;
Giannakis, Georgios B. .
IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (06) :4328-4341
[7]   An Online Convex Optimization Approach to Proactive Network Resource Allocation [J].
Chen, Tianyi ;
Ling, Qing ;
Giannakis, Georgios B. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (24) :6350-6364
[8]   An Efficient Incentive Mechanism for Device-to-Device Multicast Communication in Cellular Networks [J].
Chen, Yichao ;
He, Shibo ;
Hou, Fen ;
Shi, Zhiguo ;
Chen, Jiming .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (12) :7922-7935
[9]   Optimal Contract Design for Efficient Federated Learning With Multi-Dimensional Private Information [J].
Ding, Ningning ;
Fang, Zhixuan ;
Huang, Jianwei .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (01) :186-200
[10]   Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation [J].
Dinh, Canh T. ;
Tran, Nguyen H. ;
Nguyen, Minh N. H. ;
Hong, Choong Seon ;
Bao, Wei ;
Zomaya, Albert Y. ;
Gramoli, Vincent .
IEEE-ACM TRANSACTIONS ON NETWORKING, 2021, 29 (01) :398-409