Joint Job Assignment and Resource Allocation for Multi-Job Wireless Federated Learning

被引:0
|
作者
Li, Tan [1 ]
Wei, Zeheng [1 ]
Liu, Hai [1 ]
Lin, Zhiyong [2 ]
Chan, Tse-Tin [3 ]
机构
[1] Hang Seng Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[3] Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Peoples R China
关键词
Learning efficiency; multi-job optimization; resource allocation; system efficiency; wireless federated learning; OPTIMIZATION; INTERNET;
D O I
10.1109/MASS62177.2024.00062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wireless Federated Learning (WFL) marks a significant evolution in edge artificial intelligence (AI), allowing for collaborative learning while preserving the privacy of edge devices. Recently, the enhanced data collection and storage capability of edge devices have precipitated a paradigm shift from training an individual model (single-job) to multiple AI models (multi-job). This shift poses a new challenge in maintaining high system performance while managing resource management among multiple jobs. In this work, we address the challenge of a multi-job WFL framework by optimizing its dual efficiency. We formulate a multi-objective optimization problem with the goal of minimizing energy consumption and execution time to enhance system efficiency, while ensuring that all AI jobs meet their predefined performance criteria, thereby guaranteeing learning efficiency. To solve the problem, we propose an algorithm that jointly optimizes job assignment and resource allocation, by considering the triple-heterogeneity of data, devices, and jobs in the multi-job WFL framework. Specifically, a matching game-based method is utilized to assign jobs to capable devices, considering their respective contributions and costs, while convex optimization techniques are employed to refine the resource allocation toward computing frequency and transmission power. The performance of the algorithm is evaluated through numerical simulations in terms of system and learning performance over multiple AI model training jobs, showing that our proposed algorithm ensures time and energy efficiency under the same learning performance constraints.
引用
收藏
页码:419 / 427
页数:9
相关论文
共 50 条
  • [41] Resource Allocation for Wireless Federated Edge Learning based on Data Importance
    He, Yinghui
    Ren, Jinke
    Yu, Guanding
    Yuan, Jiantao
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [42] Efficient Federated Learning Algorithm for Resource Allocation in Wireless IoT Networks
    Van-Dinh Nguyen
    Sharma, Shree Krishna
    Vu, Thang X.
    Chatzinotas, Symeon
    Ottersten, Bjorn
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (05) : 3394 - 3409
  • [43] FEDRESOURCE: Federated Learning Based Resource Allocation in Modern Wireless Networks
    Satheesh, P. G.
    Sasikala, T.
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2023, 14 (09) : 1023 - 1030
  • [44] Device Selection and Resource Allocation for Layerwise Federated Learning in Wireless Networks
    Lee, Hyun-Suk
    IEEE SYSTEMS JOURNAL, 2022, 16 (04): : 6441 - 6444
  • [45] Federated Learning Over Wireless Networks: Convergence Analysis and Resource Allocation
    Dinh, Canh T.
    Tran, Nguyen H.
    Nguyen, Minh N. H.
    Hong, Choong Seon
    Bao, Wei
    Zomaya, Albert Y.
    Gramoli, Vincent
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2021, 29 (01) : 398 - 409
  • [46] Joint Partial Offloading and Resource Allocation for Vehicular Federated Learning Tasks
    Ma, Guifu
    Hu, Manjiang
    Wang, Xiaowei
    Li, Haoran
    Bian, Yougang
    Zhu, Konglin
    Wu, Di
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (08) : 8444 - 8459
  • [47] Joint Training and Resource Allocation Optimization for Federated Learning in UAV Swarm
    Shen, Yun
    Qu, Yuben
    Dong, Chao
    Zhou, Fuhui
    Wu, Qihui
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 2272 - 2284
  • [48] Multi-objective simulation optimization for uncertain resource assignment and job sequence in automated flexible job shop
    Amiri, Farbod
    Shirazi, Babak
    Tajdin, Ali
    APPLIED SOFT COMPUTING, 2019, 75 : 190 - 202
  • [49] Joint User Selection and Resource Allocation for Fast Federated Edge Learning
    JIANG Zhihui
    HE Yinghui
    YU Guanding
    ZTECommunications, 2020, 18 (02) : 20 - 30
  • [50] Federated Learning for Cellular Networks: Joint User Association and Resource Allocation
    Khan, Latif U.
    Majeed, Umer
    Hong, Choong Seon
    APNOMS 2020: 2020 21ST ASIA-PACIFIC NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM (APNOMS), 2020, : 405 - 408