Joint Job Assignment and Resource Allocation for Multi-Job Wireless Federated Learning

被引:0
|
作者
Li, Tan [1 ]
Wei, Zeheng [1 ]
Liu, Hai [1 ]
Lin, Zhiyong [2 ]
Chan, Tse-Tin [3 ]
机构
[1] Hang Seng Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[3] Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Peoples R China
关键词
Learning efficiency; multi-job optimization; resource allocation; system efficiency; wireless federated learning; OPTIMIZATION; INTERNET;
D O I
10.1109/MASS62177.2024.00062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wireless Federated Learning (WFL) marks a significant evolution in edge artificial intelligence (AI), allowing for collaborative learning while preserving the privacy of edge devices. Recently, the enhanced data collection and storage capability of edge devices have precipitated a paradigm shift from training an individual model (single-job) to multiple AI models (multi-job). This shift poses a new challenge in maintaining high system performance while managing resource management among multiple jobs. In this work, we address the challenge of a multi-job WFL framework by optimizing its dual efficiency. We formulate a multi-objective optimization problem with the goal of minimizing energy consumption and execution time to enhance system efficiency, while ensuring that all AI jobs meet their predefined performance criteria, thereby guaranteeing learning efficiency. To solve the problem, we propose an algorithm that jointly optimizes job assignment and resource allocation, by considering the triple-heterogeneity of data, devices, and jobs in the multi-job WFL framework. Specifically, a matching game-based method is utilized to assign jobs to capable devices, considering their respective contributions and costs, while convex optimization techniques are employed to refine the resource allocation toward computing frequency and transmission power. The performance of the algorithm is evaluated through numerical simulations in terms of system and learning performance over multiple AI model training jobs, showing that our proposed algorithm ensures time and energy efficiency under the same learning performance constraints.
引用
收藏
页码:419 / 427
页数:9
相关论文
共 50 条
  • [21] Single machine due window assignment resource allocation scheduling with job-dependent learning effect
    Yin, Na
    JOURNAL OF APPLIED MATHEMATICS AND COMPUTING, 2018, 56 (1-2) : 715 - 725
  • [22] Grid Computing Platform for Secure Multi-Job Operation
    Kim, Jiho
    Lee, Minhyun
    Song, Ohyoung
    11TH INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION TECHNOLOGY, VOLS I-III, PROCEEDINGS,: UBIQUITOUS ICT CONVERGENCE MAKES LIFE BETTER!, 2009, : 432 - 435
  • [23] Improving Multi-Job MapReduce Scheduling in an Opportunistic Environment
    Ji, Yuting
    Tong, Lang
    He, Ting
    Tan, Jian
    Lee, Kang-won
    Zhang, Li
    2013 IEEE SIXTH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (CLOUD 2013), 2013, : 9 - 16
  • [24] Federated Learning Based Resource Allocation for Wireless Communication Networks
    Behmandpoor, Pourya
    Patrinos, Panagiotis
    Moonen, Marc
    2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, : 1656 - 1660
  • [25] Joint Device Participation, Dataset Management, and Resource Allocation in Wireless Federated Learning via Deep Reinforcement Learning
    Chen, Jinlian
    Zhang, Jun
    Zhao, Nan
    Pei, Yiyang
    Liang, Ying-Chang
    Niyato, Dusit
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (03) : 4505 - 4510
  • [26] Joint Resource Allocation and User Scheduling Scheme for Federated Learning
    Shen, Jinglong
    Cheng, Nan
    Yin, Zhisheng
    Xu, Wenchao
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [27] Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning
    Wen, Wanli
    Chen, Zihan
    Yang, Howard H.
    Xia, Wenchao
    Quek, Tony Q. S.
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2022, 21 (08) : 5857 - 5872
  • [28] Joint Accuracy and Resource Allocation for Green Federated Learning Networks
    Chu, Xu
    Liu, Xiaoyang
    Chen, Qimei
    Xiong, Yunfei
    Wang, Juanjuan
    Yu, Han
    Hu, Xiang
    SMART COMPUTING AND COMMUNICATION, 2022, 13202 : 154 - 163
  • [29] PISCES: Optimizing Multi-Job Application Execution in MapReduce
    Chen, Qi
    Yao, Jinyu
    Li, Benchao
    Xiao, Zhen
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2019, 7 (01) : 273 - 286
  • [30] Resource Allocation for Multi-Task Federated Learning Algorithm over Wireless Communication Networks
    Cao, Binghao
    Chen, Ming
    Ben, Yanglin
    Yang, Zhaohui
    Hu, Yuntao
    Huang, Chongwen
    Cang, Yihan
    2022 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2022, : 590 - 595